-- Logs begin at Fri 2021-11-19 02:41:17 UTC, end at Fri 2021-11-19 03:43:42 UTC. -- Nov 19 03:11:43.358128 dv-cinder-818037-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 19 03:11:43.366689 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 19 03:11:43.368641 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Nov 19 03:11:43 2021] *** Nov 19 03:11:43.368641 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 19 03:11:43.368641 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 19 03:11:43.368641 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: nodename: dv-cinder-818037-4-iscsi Nov 19 03:11:43.368641 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: machine: x86_64 Nov 19 03:11:43.368641 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: clock source: unix Nov 19 03:11:43.368641 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: pcre jit disabled Nov 19 03:11:43.368641 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: detected number of CPU cores: 4 Nov 19 03:11:43.368641 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: current working directory: / Nov 19 03:11:43.368641 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: detected binary path: /usr/bin/uwsgi-core Nov 19 03:11:43.369278 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: your processes number limit is 47680 Nov 19 03:11:43.369278 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: your memory page size is 4096 bytes Nov 19 03:11:43.369278 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: detected max file descriptor number: 2048 Nov 19 03:11:43.369278 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: lock engine: pthread robust mutexes Nov 19 03:11:43.369278 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: thunder lock: enabled Nov 19 03:11:43.369278 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 19 03:11:43.369278 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 19 03:11:43.412709 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: Python main interpreter initialized at 0x561c9d9d59c0 Nov 19 03:11:43.412709 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: python threads support enabled Nov 19 03:11:43.412709 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: your server socket listen backlog is limited to 100 connections Nov 19 03:11:43.412709 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: your mercy for graceful operations on workers is 90 seconds Nov 19 03:11:43.413041 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: mapped 403077 bytes (393 KB) for 2 cores Nov 19 03:11:43.413117 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: *** Operational MODE: preforking *** Nov 19 03:11:43.413366 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: *** uWSGI is running in multiple interpreter mode *** Nov 19 03:11:43.413366 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: spawned uWSGI master process (pid: 101844) Nov 19 03:11:43.413544 dv-cinder-818037-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 19 03:11:43.415069 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: spawned uWSGI worker 1 (pid: 101845, cores: 1) Nov 19 03:11:43.415069 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: spawned uWSGI worker 2 (pid: 101846, cores: 1) Nov 19 03:11:43.415069 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 19 03:11:45.026109 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 03:11:45.026109 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: from cryptography.utils import int_from_bytes Nov 19 03:11:45.026750 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 03:11:45.026750 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: from cryptography.utils import int_from_bytes Nov 19 03:11:45.027193 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 03:11:45.027193 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: from cryptography.utils import int_from_bytes Nov 19 03:11:45.027322 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 03:11:45.027322 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: from cryptography.utils import int_from_bytes Nov 19 03:11:47.522810 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 03:11:47.523458 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 03:11:47.523560 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 03:11:47.523884 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 03:11:47.524135 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 03:11:47.524514 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.524843 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.525161 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.525372 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 03:11:47.525730 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.525811 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 03:11:47.525889 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.526084 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.526186 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 03:11:47.526402 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.526521 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 03:11:47.526716 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 03:11:47.526802 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.527056 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.527154 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.527312 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.527409 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.527625 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.527714 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.527946 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-4-iscsi {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.528040 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.528266 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.528352 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.528596 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.528771 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.528918 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.529135 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.529278 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.529599 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.529736 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.529932 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.530062 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.530194 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.530327 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.530514 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.530830 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.532251 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-4-iscsi {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.532251 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.532508 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.532623 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.532755 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.532882 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.533019 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.533141 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.533266 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.533396 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.533527 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.533662 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.533788 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.533912 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.534044 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.534044 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.534292 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.534545 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.534688 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.534822 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.534957 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.535073 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-4-iscsi {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.535210 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.535323 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.535446 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.535569 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.535569 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.535823 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.535823 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.536056 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.536189 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.536321 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.536454 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.536588 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.536711 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.536834 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.536964 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.537101 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.537236 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.537365 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-4-iscsi {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.537508 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.537633 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.537758 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.537889 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.538023 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.538157 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.538343 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.538499 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.538672 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.538812 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.538977 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.539115 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.539282 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.539411 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.539596 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.539725 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.539897 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.540034 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.540199 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.540338 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.540470 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.540605 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.540740 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.540926 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.541056 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.541247 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.541387 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.541551 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.541689 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.541860 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.541996 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.542123 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.542261 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.542420 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.542582 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.542762 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.542883 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.543067 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.543195 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.543332 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.543464 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.543617 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.543752 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.543942 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.544069 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.544774 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.544908 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.545758 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.545898 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.545898 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.546153 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.546286 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.546413 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.546567 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.546696 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.546835 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.546975 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.547101 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.547233 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.547358 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.547482 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.547606 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.547746 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.547872 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.548010 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.548136 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.548260 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.548395 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.548520 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.548645 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.548776 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.548902 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.549026 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.549159 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.549273 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.549395 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.549526 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.549660 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.549811 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.549948 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.550118 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.550254 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.550425 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.550622 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.550751 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.550889 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.551062 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.551191 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.551397 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.551526 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.551700 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.551829 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.551955 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.552079 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.552236 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.552396 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.552534 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.552716 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.552844 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.553024 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.553160 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.553330 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.553468 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.553639 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.553783 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.553958 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.554088 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.554288 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.554423 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.554624 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.554751 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.554875 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.555011 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.555136 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.555269 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.555431 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.555571 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.555751 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.555879 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.556057 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.556187 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.556361 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.556494 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.556662 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.556790 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.556959 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.557087 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.557264 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.557393 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.557569 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.557697 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.557870 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.558005 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.558171 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.558300 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.558491 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.558636 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.558842 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.558967 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.559101 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.559228 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.559385 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.559515 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.559691 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.560678 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.560678 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.560933 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.561059 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.561223 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.561361 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.561496 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.561622 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.561747 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.561878 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.562017 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.562143 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.562278 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.562414 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.562581 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.562709 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.562859 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.562997 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.563163 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.563292 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.563481 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.563610 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.563788 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.563917 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.564094 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.564224 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.564410 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.564572 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.564709 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.564834 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.564999 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.565128 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.565307 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.565435 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.565603 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.565738 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.565911 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.566041 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.566226 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.566352 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.566550 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.566680 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.566854 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.566980 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.567154 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.567293 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.567457 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.567595 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.567759 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.567888 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.568064 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.568202 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.568368 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.568533 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.568661 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.568786 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.568958 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.569099 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.569273 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.569401 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.569591 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.569719 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.569898 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.570036 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.570205 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.570334 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.570529 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.570662 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.570852 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:11:47.570989 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.571170 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.571297 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.571478 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.571606 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.571795 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.571925 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.572110 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.572246 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.572437 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.572565 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.572751 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.572888 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.573063 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.573192 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.573369 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.573504 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.573674 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.573800 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.573986 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.574116 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.574293 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.574433 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.574629 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.574758 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.574925 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.575054 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.575242 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.575370 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.575598 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.575738 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.575930 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.576202 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.576331 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.576541 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.576662 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.576855 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.576991 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.577162 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.577288 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.577478 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.577614 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.577788 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.577915 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.578100 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.578228 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.578405 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.578552 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.578761 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.578888 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.579072 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.579208 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.579398 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.579532 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.579713 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.579847 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.580021 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.580158 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.580323 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.580450 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.580628 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.580756 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.580933 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.581136 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.581272 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.581397 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.581521 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.581643 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.581833 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.581970 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.582144 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.582272 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.582452 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.582651 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.582804 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.582949 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.583112 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.583246 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.583414 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.583548 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.583715 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.583851 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.584016 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.584145 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.584324 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.584454 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.584625 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.584761 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.584926 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.585059 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.585254 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.585389 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.585557 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.585684 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.585857 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.585983 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.586177 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.586312 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.586494 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.586637 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.586803 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.586935 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.587104 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.587240 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.587411 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.587539 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.587723 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.587854 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.588026 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.588141 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.588343 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.588441 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.588652 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.588747 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.588957 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.589063 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.589275 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.589370 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.589581 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.589692 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.589887 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.589995 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.590198 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.590293 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.590530 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.590633 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.590842 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.590930 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.591224 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.591324 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.591553 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.591646 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.591928 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.592028 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.592247 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.592362 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.592552 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.592788 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.592888 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.593151 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.593306 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.593460 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.593764 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.593906 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.594068 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.594269 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.594399 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.594703 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.594835 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.595010 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.595318 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.595455 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.595619 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.595833 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.595970 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.596250 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.596379 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.596553 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.596739 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.596893 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.597212 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.597350 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.597525 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.597685 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.597847 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.598158 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.598296 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.598490 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.598667 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.598797 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.599097 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.599226 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.599406 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.599602 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.599732 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.600019 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.600155 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.600328 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.600530 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.600660 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.600941 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.601069 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.601263 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.601497 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.601640 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.601872 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.602001 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.602175 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.602435 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.602678 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.602820 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.602946 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.603150 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.603452 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.603582 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.603772 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.603931 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.604081 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.604392 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.604521 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.604700 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.604971 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.605109 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.605317 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.605537 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.605675 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.605907 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.606116 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.606253 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.606540 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.607238 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.607472 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.607771 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.607923 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.608192 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.608321 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.608516 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.608822 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.608951 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.609137 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.609453 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.609583 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.609855 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.609992 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.610190 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.610454 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.610641 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.610856 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.611025 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.611162 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.611498 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.611628 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.611816 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.612105 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.612235 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.612438 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.612643 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.612782 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.613097 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.613225 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.613434 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.613693 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.613837 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.614064 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.614235 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.614365 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.614704 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.614929 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.615067 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.615317 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.615446 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.615629 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.615865 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.616005 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.616330 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.616460 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.616655 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.616943 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.617084 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.617277 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.617398 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.617589 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.617812 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.617942 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.618198 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.618334 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.618547 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.618862 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.618994 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.619183 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.619310 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.619501 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.619631 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.619804 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.619932 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.620108 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.620246 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.620430 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.620560 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.620739 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.620871 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.621044 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.621184 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.621350 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.621480 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.621655 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.621786 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.621977 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.622121 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.622398 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.623066 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.623210 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.623396 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.623529 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.623802 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.623932 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.624122 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.624266 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.624443 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.624582 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.624751 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.624886 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.625062 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.625189 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.625371 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.625528 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.625687 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.625818 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.625993 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.626129 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.626300 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.626438 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.626615 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.626740 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.626928 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.627058 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.627238 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.627381 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.627534 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.627660 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.627850 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.627978 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.628159 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.628297 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.628466 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.628598 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.628764 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.628899 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.629070 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.629200 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.629383 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.629539 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.629689 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.629958 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.630097 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.630284 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.630412 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.630618 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.630747 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.630933 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.631076 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.631248 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.631378 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.631562 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.631700 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.631884 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.632022 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.632196 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.632333 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.632504 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.632640 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.632808 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.632940 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.633115 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.633237 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.633417 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.633554 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.633719 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.633850 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.634028 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.634158 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.634328 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.634465 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.634659 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.634788 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.634943 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.635073 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.635250 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.635388 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.635555 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.635692 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.635858 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.635986 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.636198 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.636500 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.636643 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.636809 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.636938 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.637108 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.637237 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.637415 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.637554 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.637713 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.637844 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.638120 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.638434 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.638581 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.638762 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.638984 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.639122 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.639353 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.639489 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.639693 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.639833 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.639997 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.640128 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.640319 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.640447 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.640648 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.640820 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.640985 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.641288 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.641416 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.641590 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.641861 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.641990 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.642200 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.642373 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.642535 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.642814 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.642955 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.643121 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.643420 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.643549 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.643718 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.643916 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.644114 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.644316 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.644445 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.644621 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.644878 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.645016 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.645210 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.645362 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.645519 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.645818 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.646194 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.646383 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.646604 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.646746 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.647007 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.647134 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.647307 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.647550 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.647680 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.647906 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.648089 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.648218 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.648497 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.648634 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.648797 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.649049 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.649179 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.649398 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.649534 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.649697 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.649995 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.650123 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.650302 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.650505 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.650637 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.650924 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.651065 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.651245 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.651474 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.651604 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.651836 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.651978 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.652136 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.652409 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.652540 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.652723 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.652884 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.653026 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.653315 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.653442 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.653679 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.653927 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.654179 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.654456 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.654676 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.654907 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.655035 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.655211 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.655520 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.655661 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.655822 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.656010 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.656140 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.656416 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.656557 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.656718 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.656928 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.657058 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.657302 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.657430 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.657603 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.657869 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.658000 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.658213 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.658342 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.658534 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.658837 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.658967 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.659136 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.659321 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.659478 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.659780 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.659910 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.660135 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.660265 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.660439 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.660732 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.660871 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.661058 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.661219 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.661349 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.661658 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.661785 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.661970 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.662164 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.662293 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.662595 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.662727 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.662905 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.663149 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.663279 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.663502 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.663637 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.663801 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.664098 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.664230 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.664413 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.664572 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.664722 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.665039 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.665177 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.665361 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.665525 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.665679 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.665980 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.666109 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.666285 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.666462 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.666612 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.666913 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.667041 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.667217 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.667437 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.667568 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.667817 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.667935 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.668122 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.668387 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.668566 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.668724 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.668852 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.669029 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.669784 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.669963 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.670282 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.670413 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.670727 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.670856 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.671035 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.671261 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.671394 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.671657 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.671785 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.671960 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.672240 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.672379 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.672559 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.672717 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.672867 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.673169 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.673298 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.673601 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.673732 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.673912 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.674096 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.674226 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.674436 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.674606 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.674836 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.674965 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.675143 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.675270 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.675457 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.675677 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.675806 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.676066 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.676193 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.676478 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.676680 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.676809 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.677075 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.677214 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.677384 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.677548 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.677692 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.677974 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.678102 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.678282 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.678555 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.678703 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.678890 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.679020 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.679210 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.679339 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.679513 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.679659 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.679833 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.680110 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.680240 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.680442 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.680569 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.680855 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.681062 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.681192 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.681451 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.681578 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.681863 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.682004 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.682174 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.682495 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.682625 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.682824 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.682972 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.683145 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.683308 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.683467 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.683657 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.683785 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.684071 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.684200 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.684379 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.684676 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.684952 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.685625 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.685748 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.685922 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.686209 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.686340 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.686642 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.686774 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.686974 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.687270 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.687401 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.687599 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.687734 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.687927 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.688060 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.688330 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.688459 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.688652 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.688831 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.688973 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.689268 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.689397 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.689594 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.689780 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.689917 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.690188 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.690318 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.690514 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.690765 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.690887 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.691109 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.691293 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.691424 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.691717 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.691847 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.692026 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.692289 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.692449 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.692624 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.692755 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.692922 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.693108 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.693246 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.693422 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.693553 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.693744 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.693873 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.694060 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.694199 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.694373 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.694543 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.694727 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.694858 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.695043 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.695186 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.695343 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.695472 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.695661 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.695789 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.695969 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.696098 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.696269 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.696407 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.696569 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.696699 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.696869 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.697000 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.697180 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.697308 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.697493 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.697624 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.697801 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.697932 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.698126 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.698248 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.698436 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.698600 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.698771 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.698899 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.699100 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.699230 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.699419 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.699555 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.699730 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.699857 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.700037 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.700172 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.700357 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.700579 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.700781 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.700938 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.701181 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.701309 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.701435 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.701573 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.701722 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.701863 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.701990 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.702115 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.702239 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.702364 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.702513 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.702654 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.702780 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.702905 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.703030 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.703287 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.703421 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.703603 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.703741 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.703903 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.704040 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.704214 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.704349 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.704518 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.704645 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.704816 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.704945 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.705115 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.705262 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.705444 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.705594 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.705723 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.705848 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.706017 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.706160 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.706321 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.706459 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.706650 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.706788 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.706960 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.707109 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.707282 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.707413 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.707584 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.707720 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.707904 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.708042 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.708218 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.708348 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.708531 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.708661 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.708843 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.708974 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.709155 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.709284 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.709465 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.709594 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.709774 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.709905 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.710085 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.710216 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.710390 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.710537 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.710724 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.710856 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.711033 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.711163 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.711346 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.711477 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.711703 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.711869 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.712006 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.712194 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.712326 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.712504 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.712635 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.712814 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.712944 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.713121 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.713260 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.713432 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.713562 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.713739 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.713869 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.714047 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.714211 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.714354 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.714559 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.714707 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.714873 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.715011 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.715195 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.715327 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.715520 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.715650 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.715825 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.715955 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.716375 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.716522 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.716678 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.716808 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.717000 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.717136 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.717313 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.717445 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.717636 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.717766 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.717943 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.718253 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.718411 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.718587 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.718727 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.718867 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.718995 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.719130 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.719259 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.719385 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.719511 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.719650 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.719779 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.719921 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.720050 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.720176 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.720370 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.720511 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.720686 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.720818 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.720990 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.721121 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.721296 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.721424 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.721601 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.721733 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.721913 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.722042 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.722220 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.722349 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.722538 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.722682 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.722838 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.722969 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.723142 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.723282 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.723481 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.723610 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.723790 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.723920 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.724112 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.724297 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.724429 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.724613 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.724756 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.724944 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.725083 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.725285 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.725424 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.725588 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.725722 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.725887 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.726026 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.726203 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.726342 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.726550 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.726683 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.726856 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.727009 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.727160 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.727291 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.727468 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.727620 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.727775 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.727914 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.728076 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.728215 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.728377 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.728506 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.728685 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.728829 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.728983 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.729113 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.729283 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.729411 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.729586 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.729725 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.729908 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.730109 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.730241 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.730455 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.730617 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.730795 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.730926 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.731119 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.731250 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.731431 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.731572 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.732240 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.732374 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.732568 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.732710 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.732885 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.733093 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.733224 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.733353 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.733479 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.733613 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.733769 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.733909 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.734078 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.734209 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.734380 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.734563 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.734706 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.734857 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.734988 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.735177 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.735307 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.735495 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.735634 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.735810 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.735940 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.736124 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.736255 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.736437 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.736578 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.736753 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.736884 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.737051 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.737330 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.737462 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.737648 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.737780 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.737945 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.738074 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.738246 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.738386 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.738568 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.738704 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.738870 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.739111 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.739243 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.739440 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.739573 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.739756 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.739886 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.740054 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.740191 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.740362 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.740494 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.740669 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.740796 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.740979 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.741152 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.741291 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.741406 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.741585 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.741715 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.741887 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.742024 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.742189 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.742318 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.742526 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.742661 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.742839 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.742987 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.743163 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.743292 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.743473 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.743602 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.743782 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.743925 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.744109 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.744237 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.744423 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.744555 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.744738 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.744951 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.745081 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.745335 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.745472 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.745660 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.745799 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.745992 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.746120 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.746308 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.746439 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.746648 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.746788 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.746953 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.747083 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.747261 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.747988 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.748158 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.748290 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.748639 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.748766 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.748956 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.749088 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.749268 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.749398 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.749580 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.749709 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.749890 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.750028 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.750201 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.750333 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.750535 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.750684 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.750849 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.750993 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.751161 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.751297 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.751473 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.751601 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.751791 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.751936 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.752120 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.752308 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.752439 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.752628 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.752758 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.752962 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.753094 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.753303 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.753446 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.753612 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.753752 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.753924 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.754053 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.754231 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.754362 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.754567 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.754712 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.754880 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.755009 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.755186 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.755318 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.755490 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.755637 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.755799 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.755920 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.756104 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.756246 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.756427 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.756567 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.756740 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.756871 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.757047 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.757178 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.757365 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.757505 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.757676 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.757808 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.758011 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.758201 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.758341 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.758576 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.758709 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.758895 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.759026 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.759221 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.759364 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.759545 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.759676 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.759862 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.759996 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.760169 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.760300 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.760476 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.760607 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.760780 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.760911 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.761083 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.761214 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.761399 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.761537 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.761709 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.761848 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.762011 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.762143 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.762314 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.762459 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.762649 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.762780 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.763021 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.763152 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.763309 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.763438 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.763621 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.763762 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.763926 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.764064 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.764254 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.764385 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.764559 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.764698 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.764862 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.764993 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.765165 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.765297 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.765475 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.765614 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.765777 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.765908 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.766079 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.766210 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.766380 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.766565 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.766696 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.766831 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.767006 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.767136 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.767309 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.767441 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.767618 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.767749 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.767920 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.768057 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.768230 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.768362 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.768533 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.768694 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.768843 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.768967 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.769146 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.769285 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.769469 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.769606 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.769773 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.769945 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.770086 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.770220 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.770376 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.770530 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.770706 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.770851 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.771275 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.771406 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.771586 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.771714 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.771898 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.772038 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.772218 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.772347 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.772541 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.772671 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.772910 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.773058 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.773190 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.773431 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.773564 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.773754 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.773899 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.774100 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.774233 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.774439 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.774599 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.774771 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.774913 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.775072 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.775202 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.775330 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 03:11:47.775456 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.775685 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.775996 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.776307 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.776616 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.776925 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.777235 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.777543 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.777852 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.778159 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.778489 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.779322 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.779662 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.779980 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.780295 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.780611 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.780927 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.781238 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.781547 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.781858 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.782165 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.782519 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.782831 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.783143 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.783450 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.783870 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.784179 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.784493 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.784811 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.785120 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.785440 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.785761 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.786071 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.786388 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.786722 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.787049 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.787386 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.787712 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.788045 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.788335 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.788639 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.788942 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.789249 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.789578 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.789913 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.790228 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.790575 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.790887 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.791207 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.791515 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.791834 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.792154 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.792471 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.792781 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.793422 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.794011 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.794584 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.794920 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.795223 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.795535 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.795848 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.796180 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.796508 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.796811 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.797138 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.797452 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.797774 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.798086 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.798178 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG oslo_db.sqlalchemy.engines [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:11:47.798395 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.798751 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.799062 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.799378 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.799687 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.800001 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.800321 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.800632 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.800955 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.801280 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.801608 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.801932 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.802278 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.802612 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.802958 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.803283 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.803599 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.803911 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.804215 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:11:47.804458 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 03:11:47.827443 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_db.sqlalchemy.engines [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:11:47.864285 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.context [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f5aef8a-580c-45ec-80bb-74d6e2886ba8(cell1) {{(pid=101845) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 03:11:47.868476 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG oslo_concurrency.lockutils [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:11:47.870041 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG oslo_concurrency.lockutils [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:11:47.870887 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG oslo_concurrency.lockutils [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:11:47.873369 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG oslo_concurrency.lockutils [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:11:47.883758 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG oslo_db.sqlalchemy.engines [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:11:47.886290 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG oslo_db.sqlalchemy.engines [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:11:47.894154 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.context [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f5aef8a-580c-45ec-80bb-74d6e2886ba8(cell1) {{(pid=101846) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 03:11:47.898672 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:11:47.900248 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:11:47.901074 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:11:47.903051 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:11:47.915420 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_db.sqlalchemy.engines [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:11:47.917982 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_db.sqlalchemy.engines [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:11:48.144921 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG oslo_db.sqlalchemy.engines [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:11:48.180483 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_db.sqlalchemy.engines [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:11:48.494961 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: WARNING keystonemiddleware.auth_token [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 03:11:48.497833 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: WARNING keystonemiddleware.auth_token [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 03:11:48.501948 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: WARNING keystonemiddleware.auth_token [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 03:11:48.505189 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: WARNING keystonemiddleware.auth_token [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 03:11:48.727746 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: WARNING keystonemiddleware.auth_token [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 03:11:48.729081 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: WARNING keystonemiddleware.auth_token [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 03:11:48.733409 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: WARNING keystonemiddleware.auth_token [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 03:11:48.735113 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: WARNING keystonemiddleware.auth_token [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 03:11:48.738684 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561c9d9d59c0 pid: 101846 (default app) Nov 19 03:11:48.740421 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561c9d9d59c0 pid: 101845 (default app) Nov 19 03:11:48.740736 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:11:48.741912 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-fe0592d7-09e1-4a0a-88c0-c4c17d121484 None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001722 Nov 19 03:11:48.742337 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Fri Nov 19 03:11:48 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:13:08.958361 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:08.959610 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001989 Nov 19 03:13:08.960169 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:13:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:13:09.523155 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-691768cb-00cf-43c3-b191-df2958251e6d admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:09.552782 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-691768cb-00cf-43c3-b191-df2958251e6d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.586316 Nov 19 03:13:09.562665 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 2/3] 10.222.0.47 () {60 vars in 1291 bytes} [Fri Nov 19 03:13:08 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:13:11.895776 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:11.897055 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-1306a493-026e-44bf-a888-67f9ec27889d None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001741 Nov 19 03:13:11.897706 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 2/4] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:13:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:13:11.958271 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-dc7725b2-7370-4b8a-b8f5-9e06122da0c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:11.976675 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:13:11.976675 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: warnings.warn(msg) Nov 19 03:13:12.007999 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-dc7725b2-7370-4b8a-b8f5-9e06122da0c9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103606 Nov 19 03:13:12.008783 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 3/5] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Nov 19 03:13:11 2021] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:13:12.356542 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-7e43fd9d-2d0b-4b66-8517-232c3f748dfe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:12.359098 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:13:12.359098 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: warnings.warn(msg) Nov 19 03:13:12.412173 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-7e43fd9d-2d0b-4b66-8517-232c3f748dfe admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.394940 Nov 19 03:13:12.412957 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 3/6] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Nov 19 03:13:12 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:13:14.729952 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-dc7725b2-7370-4b8a-b8f5-9e06122da0c9 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:14.731057 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-dc7725b2-7370-4b8a-b8f5-9e06122da0c9 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Nov 19 03:13:14.731459 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 4/7] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:13:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:13:14.848177 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-75fec9c4-d390-481c-b725-167c8a9bbd70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:14.865776 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:13:14.865776 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: warnings.warn(msg) Nov 19 03:13:14.885312 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-75fec9c4-d390-481c-b725-167c8a9bbd70 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147074 Nov 19 03:13:14.885858 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 4/8] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Nov 19 03:13:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:13:14.898353 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-14419938-80ef-4df1-a27f-2b0e5dc4ca67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:14.900249 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:13:14.900249 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: warnings.warn(msg) Nov 19 03:13:14.934661 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-14419938-80ef-4df1-a27f-2b0e5dc4ca67 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039751 Nov 19 03:13:14.942132 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 5/9] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Nov 19 03:13:14 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:13:17.248106 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-75fec9c4-d390-481c-b725-167c8a9bbd70 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:17.249761 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-75fec9c4-d390-481c-b725-167c8a9bbd70 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Nov 19 03:13:17.250351 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:13:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:13:17.321524 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-7471f5e9-984d-4da0-98cf-03e9c70b2ab4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "ram": 1024, "id": "d2"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:17.341052 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-7471f5e9-984d-4da0-98cf-03e9c70b2ab4 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083467 Nov 19 03:13:17.341601 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 6/11] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Nov 19 03:13:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:13:17.353897 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-0cf8f02e-d864-4f9e-a051-aea6745afc11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:17.377598 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-0cf8f02e-d864-4f9e-a051-aea6745afc11 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027289 Nov 19 03:13:17.378375 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 6/12] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Nov 19 03:13:17 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:13:19.819234 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-7471f5e9-984d-4da0-98cf-03e9c70b2ab4 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:19.820242 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-7471f5e9-984d-4da0-98cf-03e9c70b2ab4 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Nov 19 03:13:19.820646 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 7/13] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:13:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:13:19.878300 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-a3371489-e89a-4a4e-8a98-b5d125a7e5c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G", "disk": 10, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:19.896907 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-a3371489-e89a-4a4e-8a98-b5d125a7e5c7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070078 Nov 19 03:13:19.897447 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 7/14] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Nov 19 03:13:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:13:19.909931 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-23e27d85-2b48-4715-b8a4-b55b1193d1fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:19.932883 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-23e27d85-2b48-4715-b8a4-b55b1193d1fd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026732 Nov 19 03:13:19.933453 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 8/15] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Nov 19 03:13:19 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:13:22.260632 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-a3371489-e89a-4a4e-8a98-b5d125a7e5c7 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:22.261635 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-a3371489-e89a-4a4e-8a98-b5d125a7e5c7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Nov 19 03:13:22.262027 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 8/16] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:13:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:13:22.324483 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-45b60cdd-2226-4ee9-a9ed-c56e48e7656b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "vcpus": 4, "ram": 4096, "id": "d4", "rxtx_factor": 1.0}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:22.343274 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-45b60cdd-2226-4ee9-a9ed-c56e48e7656b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074441 Nov 19 03:13:22.344128 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 9/17] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Nov 19 03:13:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:13:22.356233 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-892197df-cea6-4dcd-9c8b-f9bb7a01d10d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:22.380066 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-892197df-cea6-4dcd-9c8b-f9bb7a01d10d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027609 Nov 19 03:13:22.380983 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 9/18] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Nov 19 03:13:22 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:13:24.840074 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-45b60cdd-2226-4ee9-a9ed-c56e48e7656b admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:24.841090 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-45b60cdd-2226-4ee9-a9ed-c56e48e7656b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 19 03:13:24.841501 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 10/19] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:13:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:13:24.906648 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-7bb53820-2b69-42c4-9590-6dea7709dc6d admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:24.935020 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-7bb53820-2b69-42c4-9590-6dea7709dc6d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086628 Nov 19 03:13:24.935568 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 10/20] 10.222.0.47 () {60 vars in 1291 bytes} [Fri Nov 19 03:13:24 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:13:27.701671 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-45b60cdd-2226-4ee9-a9ed-c56e48e7656b admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:27.702872 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-45b60cdd-2226-4ee9-a9ed-c56e48e7656b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Nov 19 03:13:27.703687 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 11/21] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:13:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:13:27.775900 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-c1e6a8b7-c36f-4215-a887-859fbb748842 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:27.797557 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-c1e6a8b7-c36f-4215-a887-859fbb748842 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.087040 Nov 19 03:13:27.798118 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 11/22] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Nov 19 03:13:27 2021] POST /compute/v2.1/flavors => generated 402 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:13:27.810972 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-0121f110-5f72-407b-9f47-75210935ba0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:27.835568 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-0121f110-5f72-407b-9f47-75210935ba0a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028333 Nov 19 03:13:27.836166 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 12/23] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Nov 19 03:13:27 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:13:30.392491 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-c1e6a8b7-c36f-4215-a887-859fbb748842 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:30.393580 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-c1e6a8b7-c36f-4215-a887-859fbb748842 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001609 Nov 19 03:13:30.393980 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 12/24] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:13:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:13:30.454917 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-66e8d79b-e791-4d64-8d92-c5013e496ac8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "disk": 20, "id": "2"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:30.473544 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-66e8d79b-e791-4d64-8d92-c5013e496ac8 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071778 Nov 19 03:13:30.474287 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 13/25] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Nov 19 03:13:30 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:13:30.487291 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-7ad4ef6b-6b83-4b99-ad32-590c9092cb7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:30.510739 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-7ad4ef6b-6b83-4b99-ad32-590c9092cb7b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027832 Nov 19 03:13:30.511337 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 13/26] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Nov 19 03:13:30 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:13:32.877895 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-66e8d79b-e791-4d64-8d92-c5013e496ac8 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:32.879006 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-66e8d79b-e791-4d64-8d92-c5013e496ac8 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Nov 19 03:13:32.879435 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 14/27] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:13:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:13:32.955462 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-556aad2f-356d-469c-b3c1-1600057951e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:32.976692 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-556aad2f-356d-469c-b3c1-1600057951e2 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.090651 Nov 19 03:13:32.977255 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 14/28] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Nov 19 03:13:32 2021] POST /compute/v2.1/flavors => generated 406 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:13:32.990855 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-70ea8f7f-b57f-4bee-9e85-5ea3bb669677 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:33.017342 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-70ea8f7f-b57f-4bee-9e85-5ea3bb669677 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030501 Nov 19 03:13:33.018023 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 15/29] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Nov 19 03:13:32 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:13:35.651886 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-556aad2f-356d-469c-b3c1-1600057951e2 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:35.653137 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-556aad2f-356d-469c-b3c1-1600057951e2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Nov 19 03:13:35.653702 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 15/30] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:13:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:13:35.711558 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-847f981c-655e-4d65-9de5-d66f40eab71b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:35.729037 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-847f981c-655e-4d65-9de5-d66f40eab71b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069342 Nov 19 03:13:35.729580 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 16/31] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Nov 19 03:13:35 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:13:35.741481 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-20031a3a-7be7-4e57-a05c-730299528b8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:35.766332 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-20031a3a-7be7-4e57-a05c-730299528b8c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028343 Nov 19 03:13:35.767297 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 16/32] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Nov 19 03:13:35 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:13:38.080020 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-847f981c-655e-4d65-9de5-d66f40eab71b admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:13:38.081082 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-847f981c-655e-4d65-9de5-d66f40eab71b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Nov 19 03:13:38.081475 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 17/33] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:13:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:13:38.149808 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-9cec198d-2f89-44f2-b19a-b4db742969f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "id": "5", "disk": 160}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:38.170775 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-9cec198d-2f89-44f2-b19a-b4db742969f5 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082411 Nov 19 03:13:38.178771 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 17/34] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Nov 19 03:13:38 2021] POST /compute/v2.1/flavors => generated 408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:13:38.183613 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-5a7665ca-705b-4893-9379-2dc202cde42d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:13:38.211256 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-5a7665ca-705b-4893-9379-2dc202cde42d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031297 Nov 19 03:13:38.212119 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 18/35] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Nov 19 03:13:38 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:14:03.456900 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-9cec198d-2f89-44f2-b19a-b4db742969f5 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:03.457921 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-9cec198d-2f89-44f2-b19a-b4db742969f5 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Nov 19 03:14:03.458314 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 18/36] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:14:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:14:03.514898 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-d56c814c-2d49-48bb-b9e1-20f486182927 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:03.531670 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-d56c814c-2d49-48bb-b9e1-20f486182927 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066783 Nov 19 03:14:03.532200 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 19/37] 10.222.0.47 () {60 vars in 1291 bytes} [Fri Nov 19 03:14:03 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:14:05.009100 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-9cec198d-2f89-44f2-b19a-b4db742969f5 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:05.010099 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-9cec198d-2f89-44f2-b19a-b4db742969f5 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Nov 19 03:14:05.010518 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 19/38] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Nov 19 03:14:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:14:05.200610 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-54ef5c07-eb8d-467a-84de-cde30305181d admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:05.206634 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.wsgi [None req-54ef5c07-eb8d-467a-84de-cde30305181d admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 19 03:14:05.207203 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-54ef5c07-eb8d-467a-84de-cde30305181d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:14:05.207991 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-54ef5c07-eb8d-467a-84de-cde30305181d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058654 Nov 19 03:14:05.208502 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 20/39] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Nov 19 03:14:05 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 19 03:14:05.218047 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-376fe220-4f03-4455-aa3e-8d108a42e7b5 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:05.238864 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-376fe220-4f03-4455-aa3e-8d108a42e7b5 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024268 Nov 19 03:14:05.239420 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 20/40] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Nov 19 03:14:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:14:05.249503 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-f56899e5-8855-4624-9723-bb2259d6795b admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:05.271599 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-f56899e5-8855-4624-9723-bb2259d6795b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025556 Nov 19 03:14:05.272128 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 21/41] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Nov 19 03:14:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:14:05.282144 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-d59fa5ee-3b99-4282-bb95-bbc234dbbce9 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:05.287526 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.wsgi [None req-d59fa5ee-3b99-4282-bb95-bbc234dbbce9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 19 03:14:05.288094 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-d59fa5ee-3b99-4282-bb95-bbc234dbbce9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:14:05.288886 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-d59fa5ee-3b99-4282-bb95-bbc234dbbce9 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010715 Nov 19 03:14:05.289373 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 21/42] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Nov 19 03:14:05 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 19 03:14:06.670360 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-f56899e5-8855-4624-9723-bb2259d6795b admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:06.671403 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-f56899e5-8855-4624-9723-bb2259d6795b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Nov 19 03:14:06.671792 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 22/43] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Nov 19 03:14:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:14:06.862203 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-a128c62d-9bde-487a-8004-2d4d248b5d58 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:06.867873 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.wsgi [None req-a128c62d-9bde-487a-8004-2d4d248b5d58 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 19 03:14:06.868427 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-a128c62d-9bde-487a-8004-2d4d248b5d58 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:14:06.869200 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-a128c62d-9bde-487a-8004-2d4d248b5d58 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057735 Nov 19 03:14:06.869712 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 22/44] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Nov 19 03:14:06 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 03:14:06.879572 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-6f2c0570-8fc6-4509-9130-a2a0f5f13e5e admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:06.893685 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-6f2c0570-8fc6-4509-9130-a2a0f5f13e5e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017634 Nov 19 03:14:06.894253 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 23/45] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Nov 19 03:14:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:14:06.904583 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-5e726c47-6f6a-41f6-bc4a-2bf2fde05432 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:06.918965 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-5e726c47-6f6a-41f6-bc4a-2bf2fde05432 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018164 Nov 19 03:14:06.919500 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 23/46] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Nov 19 03:14:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:14:06.929846 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-7752f6f5-53dc-4c9a-a52e-ec75defdb9cd admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:06.935011 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.wsgi [None req-7752f6f5-53dc-4c9a-a52e-ec75defdb9cd admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 19 03:14:06.935567 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-7752f6f5-53dc-4c9a-a52e-ec75defdb9cd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:14:06.936339 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-7752f6f5-53dc-4c9a-a52e-ec75defdb9cd admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009965 Nov 19 03:14:06.936825 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 24/47] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Nov 19 03:14:06 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 03:14:08.322187 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-5e726c47-6f6a-41f6-bc4a-2bf2fde05432 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:08.323215 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-5e726c47-6f6a-41f6-bc4a-2bf2fde05432 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Nov 19 03:14:08.323636 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 24/48] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Nov 19 03:14:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:14:08.514035 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-16a5eb95-0910-4583-9c00-8032f9a1281b admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:08.519609 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.wsgi [None req-16a5eb95-0910-4583-9c00-8032f9a1281b admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 19 03:14:08.520165 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-16a5eb95-0910-4583-9c00-8032f9a1281b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:14:08.520938 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-16a5eb95-0910-4583-9c00-8032f9a1281b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057502 Nov 19 03:14:08.521438 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 25/49] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Nov 19 03:14:08 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 03:14:08.531251 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-f1fcd5b9-2260-4b31-bc8b-635dac6659a4 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:08.544383 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-f1fcd5b9-2260-4b31-bc8b-635dac6659a4 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016858 Nov 19 03:14:08.544903 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 25/50] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Nov 19 03:14:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:14:08.555569 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:08.568782 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017208 Nov 19 03:14:08.569290 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 26/51] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Nov 19 03:14:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:14:08.578784 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-ee52cb8a-61a8-44dd-9e56-351cf0b40e95 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:08.583821 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.wsgi [None req-ee52cb8a-61a8-44dd-9e56-351cf0b40e95 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 19 03:14:08.584374 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-ee52cb8a-61a8-44dd-9e56-351cf0b40e95 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:14:08.585143 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-ee52cb8a-61a8-44dd-9e56-351cf0b40e95 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009815 Nov 19 03:14:08.585618 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 26/52] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Nov 19 03:14:08 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 03:14:09.963062 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:09.964058 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Nov 19 03:14:09.964444 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 27/53] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Nov 19 03:14:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:14:10.155998 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-cea46bb4-8ab1-496e-b94d-b18d282d46f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:14:10.173909 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-cea46bb4-8ab1-496e-b94d-b18d282d46f8 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068776 Nov 19 03:14:10.174372 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 27/54] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Nov 19 03:14:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:14:11.565543 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:11.566580 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Nov 19 03:14:11.566974 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 28/55] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Nov 19 03:14:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:14:11.757835 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-b5aa8b08-48f4-4556-ad21-435f9fbdaf23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:14:11.776342 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-b5aa8b08-48f4-4556-ad21-435f9fbdaf23 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068176 Nov 19 03:14:11.776808 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 28/56] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Nov 19 03:14:11 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:14:13.175180 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:13.176217 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Nov 19 03:14:13.176616 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 29/57] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Nov 19 03:14:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:14:13.367128 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-73e0b4b7-df24-4c27-9666-2001e5ddcf94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:14:13.385070 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-73e0b4b7-df24-4c27-9666-2001e5ddcf94 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067918 Nov 19 03:14:13.385600 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 29/58] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Nov 19 03:14:13 2021] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:14:14.797559 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:14.798582 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001913 Nov 19 03:14:14.798971 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 30/59] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Nov 19 03:14:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:14:14.993588 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-4b739bbb-c497-4f5f-86b3-ebd796e77ab6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:14:15.010259 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-4b739bbb-c497-4f5f-86b3-ebd796e77ab6 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069752 Nov 19 03:14:15.010896 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 30/60] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Nov 19 03:14:14 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:14:16.401193 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:16.402313 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Nov 19 03:14:16.402828 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 31/61] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Nov 19 03:14:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:14:16.595207 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-98f580a9-18b3-4364-8b52-a536b0eaa394 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:14:16.614537 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-98f580a9-18b3-4364-8b52-a536b0eaa394 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071223 Nov 19 03:14:16.615015 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 31/62] 10.222.0.47 () {60 vars in 1202 bytes} [Fri Nov 19 03:14:16 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:15:03.067921 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:15:03.068955 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-c91e27fd-72b9-4185-9d89-d8885381933d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 19 03:15:03.069359 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 32/63] 10.222.0.47 () {54 vars in 930 bytes} [Fri Nov 19 03:15:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:15:03.126547 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-18eb10c9-4101-4c54-b022-fd05db2bea6b admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:15:03.145171 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-18eb10c9-4101-4c54-b022-fd05db2bea6b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069083 Nov 19 03:15:03.145697 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 32/64] 10.222.0.47 () {60 vars in 1291 bytes} [Fri Nov 19 03:15:03 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:15:03.169429 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-90df0c83-296c-4dc0-b6a1-2bf727656320 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:15:03.176855 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-90df0c83-296c-4dc0-b6a1-2bf727656320 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011548 Nov 19 03:15:03.177356 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 33/65] 10.222.0.47 () {60 vars in 1282 bytes} [Fri Nov 19 03:15:03 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:15:03.188726 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-84ca89dc-71b5-4e38-8936-8efd25a9af7a admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:15:03.196094 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-84ca89dc-71b5-4e38-8936-8efd25a9af7a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010820 Nov 19 03:15:03.196615 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 33/66] 10.222.0.47 () {60 vars in 1285 bytes} [Fri Nov 19 03:15:03 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:15:03.208391 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-2dfc6dcd-3fb7-4faa-a1da-6d19e675193d admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:15:03.216249 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-2dfc6dcd-3fb7-4faa-a1da-6d19e675193d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011183 Nov 19 03:15:03.216756 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 34/67] 10.222.0.47 () {60 vars in 1285 bytes} [Fri Nov 19 03:15:03 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:15:03.227854 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-928b8e11-2e1d-44f2-aaaf-bb201e61e9b5 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:15:03.235245 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-928b8e11-2e1d-44f2-aaaf-bb201e61e9b5 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010779 Nov 19 03:15:03.235754 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 34/68] 10.222.0.47 () {60 vars in 1282 bytes} [Fri Nov 19 03:15:03 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:16:27.334401 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-66e2eca0-d18f-47dd-8aad-86aeb84568a5 tempest-verify_tempest_config-541550724 tempest-verify_tempest_config-541550724-project] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:16:27.336432 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-66e2eca0-d18f-47dd-8aad-86aeb84568a5 tempest-verify_tempest_config-541550724 tempest-verify_tempest_config-541550724-project] 10.222.0.47 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104240 Nov 19 03:16:27.336959 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 35/69] 10.222.0.47 () {58 vars in 1133 bytes} [Fri Nov 19 03:16:27 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:17:58.714836 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-928b8e11-2e1d-44f2-aaaf-bb201e61e9b5 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:17:58.715858 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-928b8e11-2e1d-44f2-aaaf-bb201e61e9b5 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Nov 19 03:17:58.716251 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 35/70] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Nov 19 03:17:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:17:58.969487 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-fca618d5-02ba-4738-88ef-03155754ac60 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:17:58.970709 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:17:58.970709 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: warnings.warn(msg) Nov 19 03:17:58.972241 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-fca618d5-02ba-4738-88ef-03155754ac60 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:17:58.972675 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-fca618d5-02ba-4738-88ef-03155754ac60 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:17:58.973482 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-fca618d5-02ba-4738-88ef-03155754ac60 admin admin] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:17:58.973902 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-fca618d5-02ba-4738-88ef-03155754ac60 admin admin] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:17:59.008101 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-fca618d5-02ba-4738-88ef-03155754ac60 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151545 Nov 19 03:17:59.008652 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 36/71] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Nov 19 03:17:58 2021] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:18:00.404563 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-928b8e11-2e1d-44f2-aaaf-bb201e61e9b5 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:18:00.405586 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-928b8e11-2e1d-44f2-aaaf-bb201e61e9b5 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 19 03:18:00.405974 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 36/72] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Nov 19 03:18:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:18:00.596583 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-c1caef1a-0014-4b68-a9c6-1c63333cdc68 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:18:00.597750 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:18:00.597750 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: warnings.warn(msg) Nov 19 03:18:00.599278 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-c1caef1a-0014-4b68-a9c6-1c63333cdc68 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:18:00.599717 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-c1caef1a-0014-4b68-a9c6-1c63333cdc68 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:18:00.600512 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-c1caef1a-0014-4b68-a9c6-1c63333cdc68 admin admin] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:18:00.600931 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-c1caef1a-0014-4b68-a9c6-1c63333cdc68 admin admin] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:18:00.620042 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-c1caef1a-0014-4b68-a9c6-1c63333cdc68 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074924 Nov 19 03:18:00.620507 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 37/73] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Nov 19 03:18:00 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:18:12.474693 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-928b8e11-2e1d-44f2-aaaf-bb201e61e9b5 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:18:12.475685 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-928b8e11-2e1d-44f2-aaaf-bb201e61e9b5 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Nov 19 03:18:12.476072 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 37/74] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Nov 19 03:18:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:18:12.667168 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-8a2bbc0e-b7ca-4630-bf59-ad3b30377f02 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:18:12.668314 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:18:12.668314 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: warnings.warn(msg) Nov 19 03:18:12.669801 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-8a2bbc0e-b7ca-4630-bf59-ad3b30377f02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:18:12.670239 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-8a2bbc0e-b7ca-4630-bf59-ad3b30377f02 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:18:12.671067 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-8a2bbc0e-b7ca-4630-bf59-ad3b30377f02 admin admin] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:18:12.671495 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-8a2bbc0e-b7ca-4630-bf59-ad3b30377f02 admin admin] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:18:12.695147 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-8a2bbc0e-b7ca-4630-bf59-ad3b30377f02 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079849 Nov 19 03:18:12.695616 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 38/75] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Nov 19 03:18:12 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:18:14.114450 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-928b8e11-2e1d-44f2-aaaf-bb201e61e9b5 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:18:14.115469 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-928b8e11-2e1d-44f2-aaaf-bb201e61e9b5 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Nov 19 03:18:14.115895 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 38/76] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Nov 19 03:18:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:18:14.308569 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-df8cc4da-3306-47b6-99dd-210cba9e2ed5 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:18:14.309716 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:18:14.309716 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: warnings.warn(msg) Nov 19 03:18:14.311278 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-df8cc4da-3306-47b6-99dd-210cba9e2ed5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:18:14.311717 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-df8cc4da-3306-47b6-99dd-210cba9e2ed5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:18:14.312637 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-df8cc4da-3306-47b6-99dd-210cba9e2ed5 admin admin] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:18:14.313068 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-df8cc4da-3306-47b6-99dd-210cba9e2ed5 admin admin] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:18:14.334891 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-df8cc4da-3306-47b6-99dd-210cba9e2ed5 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077808 Nov 19 03:18:14.335362 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 39/77] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Nov 19 03:18:14 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:19:12.433280 dv-cinder-818037-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 19 03:19:12.433927 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: Fri Nov 19 03:19:12 2021 - graceful shutdown triggered... Nov 19 03:19:12.434372 dv-cinder-818037-4-iscsi devstack@n-api.service[101845]: Gracefully killing worker 1 (pid: 101845)... Nov 19 03:19:12.434953 dv-cinder-818037-4-iscsi devstack@n-api.service[101846]: Gracefully killing worker 2 (pid: 101846)... Nov 19 03:19:13.435045 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: worker 1 buried after 1 seconds Nov 19 03:19:13.435623 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: worker 2 buried after 1 seconds Nov 19 03:19:13.435623 dv-cinder-818037-4-iscsi devstack@n-api.service[101844]: goodbye to uWSGI. Nov 19 03:19:13.436596 dv-cinder-818037-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 19 03:19:13.437166 dv-cinder-818037-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 19 03:19:13.440257 dv-cinder-818037-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 19 03:19:13.449711 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 19 03:19:13.452406 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Nov 19 03:19:13 2021] *** Nov 19 03:19:13.452560 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 19 03:19:13.452724 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 19 03:19:13.452920 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: nodename: dv-cinder-818037-4-iscsi Nov 19 03:19:13.453045 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: machine: x86_64 Nov 19 03:19:13.453154 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: clock source: unix Nov 19 03:19:13.453269 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: pcre jit disabled Nov 19 03:19:13.453377 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: detected number of CPU cores: 4 Nov 19 03:19:13.453484 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: current working directory: / Nov 19 03:19:13.453612 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: detected binary path: /usr/bin/uwsgi-core Nov 19 03:19:13.453612 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: your processes number limit is 47680 Nov 19 03:19:13.453612 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: your memory page size is 4096 bytes Nov 19 03:19:13.453612 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: detected max file descriptor number: 2048 Nov 19 03:19:13.453612 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: lock engine: pthread robust mutexes Nov 19 03:19:13.454056 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: thunder lock: enabled Nov 19 03:19:13.454056 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 19 03:19:13.454056 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 19 03:19:13.505963 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: Python main interpreter initialized at 0x5581633a89c0 Nov 19 03:19:13.505963 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: python threads support enabled Nov 19 03:19:13.505963 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: your server socket listen backlog is limited to 100 connections Nov 19 03:19:13.505963 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: your mercy for graceful operations on workers is 90 seconds Nov 19 03:19:13.506427 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: mapped 403077 bytes (393 KB) for 2 cores Nov 19 03:19:13.506427 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: *** Operational MODE: preforking *** Nov 19 03:19:13.506720 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: *** uWSGI is running in multiple interpreter mode *** Nov 19 03:19:13.506720 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: spawned uWSGI master process (pid: 116045) Nov 19 03:19:13.506920 dv-cinder-818037-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 19 03:19:13.507505 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: spawned uWSGI worker 1 (pid: 116065, cores: 1) Nov 19 03:19:13.509552 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: spawned uWSGI worker 2 (pid: 116066, cores: 1) Nov 19 03:19:13.509552 dv-cinder-818037-4-iscsi devstack@n-api.service[116045]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 19 03:19:15.303012 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 03:19:15.303012 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: from cryptography.utils import int_from_bytes Nov 19 03:19:15.303731 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 03:19:15.303731 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: from cryptography.utils import int_from_bytes Nov 19 03:19:15.308703 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 03:19:15.308703 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: from cryptography.utils import int_from_bytes Nov 19 03:19:15.308703 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 03:19:15.308703 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: from cryptography.utils import int_from_bytes Nov 19 03:19:17.636890 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 03:19:17.637502 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 03:19:17.637835 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 03:19:17.638103 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 03:19:17.638285 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 03:19:17.638669 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.638996 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.639322 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.639646 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.639989 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.640299 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.640622 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.640944 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.641272 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.641533 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.642450 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.642450 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-4-iscsi {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.642995 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.643070 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.643463 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.643793 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.644103 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.644429 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.644740 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.645242 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.647003 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.647003 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.647003 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.647003 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.647341 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.647541 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.647809 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.648130 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.648441 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.648758 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.649170 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-4-iscsi {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.649475 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.649790 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.650103 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.650556 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.650861 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.651158 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.651483 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.651822 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.652142 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.652465 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.652790 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.653125 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.653447 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.653748 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.654055 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.654362 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.654708 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.655016 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.655323 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.655625 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.655891 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.656213 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.656582 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.656907 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.657161 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.657410 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.657805 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.658126 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.658464 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.658965 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.659285 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.659595 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.659902 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.660210 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.660517 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.660825 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.661143 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.661460 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.661779 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.662086 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.662405 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.662835 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.663087 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.663394 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.663735 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.664051 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.664358 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.664680 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.664999 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.665308 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.665615 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.665922 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.666242 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.666596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.666905 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.667154 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.667456 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.667763 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.668082 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.668388 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.668693 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.669006 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.669307 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.669614 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.669921 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.670228 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.670554 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.670862 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.671167 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.671474 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.671779 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.672082 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.672397 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.672716 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.673022 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.673647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 03:19:17.674070 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 03:19:17.674161 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.674347 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.674686 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.674797 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 03:19:17.675013 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.675110 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 03:19:17.675322 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.675421 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 03:19:17.675630 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.675728 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.675951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.676056 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.676260 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.676351 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.676566 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.676668 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.676885 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.676984 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.677195 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.677294 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.677503 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.677601 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.677823 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.677920 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.678126 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.678222 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.678434 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.678604 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.678774 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.678866 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.679081 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.679172 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-4-iscsi {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.679391 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.679488 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.679696 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.679787 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.680064 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.680234 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.681052 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.681230 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.681323 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.681402 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.681473 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.681548 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.681625 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.681708 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.681812 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.681910 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.682142 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.682230 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.682455 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.682633 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.682792 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.682969 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.683133 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.683283 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.683452 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.683596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.683765 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.683919 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.684088 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.684261 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.684403 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.684596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.684731 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.684942 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.685029 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.685262 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.685433 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-4-iscsi {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.685597 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.685762 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.685929 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.686078 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.686249 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.686397 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.686588 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.686866 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.686960 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.687170 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.687266 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.687485 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.687577 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.687812 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.687910 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.688155 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.688245 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.688518 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.688649 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.689509 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.689777 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.690054 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.690167 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.690520 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.690626 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.690845 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.691007 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.691154 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.691287 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.691462 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.691792 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.691887 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.692120 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.692294 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.692440 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.692584 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.692734 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.692979 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.693141 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.693300 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.693435 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.693627 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.693826 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.693965 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.694183 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.694334 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.694572 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.694665 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.694762 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.694861 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.695088 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.695188 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.695410 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.695500 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.695728 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.695832 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.696042 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.696140 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.696352 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.696449 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.696661 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.696768 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.696971 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.697068 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.697280 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.697381 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.697588 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.697734 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.697898 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.697988 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.698218 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.698320 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.698554 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.698678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.698867 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.698961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.699175 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.699274 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.699493 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.699591 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.699799 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.699890 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.700119 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.700221 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.700427 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.700517 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.700741 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.700835 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.701072 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.701172 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.701381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.701515 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.701689 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.701786 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.702000 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.702100 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.702304 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.702396 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.702639 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.702745 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.702952 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.703056 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.703259 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.703351 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.703580 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.703670 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.703891 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.703994 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.704142 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.704231 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.704474 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.704641 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.704954 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.705055 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.705263 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.705454 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.705577 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.705784 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.705888 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.706104 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.706202 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.706420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.706530 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.706759 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.706864 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.707075 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.707166 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.707391 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.707483 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.707705 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.707855 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.708019 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.708181 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.708331 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.708496 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.708641 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.708826 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.708977 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.709158 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.709256 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.709485 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.709576 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.709794 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.709896 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.710107 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.710198 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.710417 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.710547 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.710752 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.710852 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.711060 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.711158 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.711372 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.711515 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.711663 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.711752 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.711974 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.712079 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.712280 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.712379 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.712586 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.712677 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.712891 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.712996 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.713196 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.713292 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.713512 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.713601 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.713818 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.713918 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.714124 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.714215 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.714427 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.714548 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.714758 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.714856 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.715070 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.715162 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.715391 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.715550 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.715721 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.716031 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.716339 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.716613 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.716766 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.716986 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.717138 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.717281 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.717423 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.717577 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.717726 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.717877 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.718028 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.718192 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.718348 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.718514 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.718663 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.718824 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.718975 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.719117 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.719259 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.719408 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.719569 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.719720 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.719873 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.720536 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 03:19:17.720692 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.720835 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.721009 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.721160 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.721338 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.721487 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.721652 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.721807 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.721979 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.722205 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.722316 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.722641 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.722843 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.723070 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.723191 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.723410 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.723511 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.723738 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.723836 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.724076 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.724187 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.724443 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.724549 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.724762 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.724875 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.725085 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.725187 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.725416 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.725518 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.725721 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.725827 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.726034 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.726132 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.726357 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.726462 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.726695 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.726794 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.727017 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.727123 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.727328 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.727434 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.727648 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.727745 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.727956 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.728053 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.728276 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.728383 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.728585 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.728694 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.728900 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.728999 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.729230 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.729360 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.729557 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.729665 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.729871 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.729962 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.730186 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.730278 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.730528 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.730635 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.730845 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.730935 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.731157 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.731248 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.731471 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.731666 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.731786 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.731923 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.732061 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.732199 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.732369 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.732468 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.732684 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.732775 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.732995 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.733092 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.733307 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.733399 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.733612 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.733709 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.733928 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.734019 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.734238 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.734374 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.734554 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.734687 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.734864 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.735007 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.735181 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.735322 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.735506 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.735695 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.736360 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.736502 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.736687 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.737028 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.737171 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.737309 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.737439 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.737608 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.737742 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.737932 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.738075 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.738243 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.738385 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.738571 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.738714 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.738881 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.739005 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.739188 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.739329 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.739519 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.739651 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.739837 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.739969 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.740145 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.740285 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.740464 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.740608 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.740773 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.740918 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.741603 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.741755 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.741897 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.742027 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.742163 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.742301 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.742444 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.742675 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.742814 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.742951 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.743080 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.743209 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.743354 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.743492 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.743622 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.743749 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.743886 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.744015 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.744159 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.744289 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.744419 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.744548 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.744676 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.744803 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.744941 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.745078 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.745208 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.745344 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.745476 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.745604 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.745741 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.745871 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.746023 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.746157 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.746341 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.746495 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.746678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.746993 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.747131 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.747305 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.747447 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.747659 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.747791 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.747920 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.748049 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.748206 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.748339 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.748514 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.748657 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.748840 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.748973 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.749153 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.749475 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.749617 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.749785 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.750094 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.750442 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.750674 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.750828 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.751029 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.751179 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.751544 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.751697 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.751924 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.752138 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.752308 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.752486 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.752635 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.752813 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.752962 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.753141 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.753300 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.753466 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.753622 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.753774 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.753918 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.754095 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.754254 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.754412 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.754594 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.754745 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.754905 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.755056 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.755199 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.755353 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.755504 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.755654 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.755797 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.755939 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.756087 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.756239 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.756395 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.756566 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.756724 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.756891 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.757048 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.757279 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.757452 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.757608 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.757759 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.757901 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.758043 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.758218 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.758388 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.758644 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.758792 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.758945 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.759090 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.759243 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.759497 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.759646 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.759823 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.759972 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.760140 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.760303 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.760447 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.760605 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.760749 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.760972 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.761120 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.761275 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.761425 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.761685 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.762027 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.762186 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.762330 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.762560 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.762744 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.763095 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.763316 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.763473 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.763661 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.763811 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.763998 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.764156 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.764301 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.764443 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.764618 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.764768 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.764944 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.765102 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.765255 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.765406 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.765559 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.765864 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.766138 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.766293 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.766492 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.766657 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.766845 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.767053 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.767282 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.767797 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.767959 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.768133 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.768480 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.768690 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.768849 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.769074 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.769233 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.769446 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.769695 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.769847 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.770545 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.770723 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.771135 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.771294 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.771458 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.771611 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.771754 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.771902 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.772052 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.772204 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.772355 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.772505 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.772650 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.772801 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.772952 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.773108 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.773260 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.773420 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.773563 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.773705 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.773857 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.774076 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.774243 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.774498 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.774682 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.774831 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.774987 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.775139 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.775289 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.775440 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.775603 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.775753 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.775914 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.776064 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.776207 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.776349 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.776498 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.776648 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.776803 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.776947 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.777095 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.777238 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.777388 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.777550 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.777694 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.777844 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.777995 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.778137 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.778279 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.778429 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.778594 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.778745 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.778901 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.779053 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.779270 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.779498 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.779642 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.779783 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.779976 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.780131 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.780285 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.780429 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.780578 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.780728 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.780870 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.781013 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.781168 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.781312 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.781476 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.781619 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.781619 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.781895 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.782050 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.782202 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.782345 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.783111 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.783308 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.783463 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.783621 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.783765 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.783906 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.784057 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.784202 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.784354 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.784506 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.784657 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.784800 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.785027 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.785171 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.785323 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.785466 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.785608 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.785749 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.785902 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.786053 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.786209 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.786362 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.786525 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.786674 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.786816 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.786970 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.787123 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.787273 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.787417 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.787568 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.787719 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.787872 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.788028 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.788181 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.788324 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.788466 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.788616 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.788779 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.788926 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.789076 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.789219 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.789370 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.789528 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.789679 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.789831 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.790057 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.790202 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.790358 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.790654 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.790816 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.790960 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.791110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.791263 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.791405 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.791555 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.791698 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.791848 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.792002 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.792158 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.792301 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.792443 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.792585 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.792727 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.792911 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.793078 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.793264 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.793421 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.793619 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.793920 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.794407 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.794813 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.795115 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.795470 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.795795 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.796122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.796438 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.796761 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.797442 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.797801 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.799974 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.800143 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.800242 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.800337 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.800422 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.800496 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.800496 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.800632 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.800720 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.800796 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.800866 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.800936 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.801006 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.801236 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.801478 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.801583 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.801804 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.801905 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.802130 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.802293 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.802454 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.802932 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.803270 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.803823 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.803939 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.804034 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.804201 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.804361 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.804460 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.804656 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.804823 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.804992 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.805288 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.805533 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.805639 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.805861 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.805967 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.806190 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.806288 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.806526 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.806780 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.806889 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.807155 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.807269 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.807470 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.807625 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.807786 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.807945 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.808109 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.808261 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.808409 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.808568 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.808723 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.809008 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.809120 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.809331 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.809438 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.809646 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.809743 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.809965 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.810071 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.810284 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.810383 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.810671 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.810840 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.811010 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.811158 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.811326 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.811485 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.811641 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.811819 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.811985 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.812153 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.812259 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.812520 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.812691 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.812845 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.813076 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.813224 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.813369 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.813534 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.813723 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.813941 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.814185 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.814185 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.814672 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.814854 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.815013 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.815175 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.815321 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.815467 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.815619 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.815781 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.815933 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.816093 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.816246 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.816398 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.816543 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.816689 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.816834 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.816993 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.817139 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.817282 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.817426 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.817570 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.817733 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.817906 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.818062 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.818215 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.818368 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.818548 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.818714 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.818861 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.819006 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.819150 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.819302 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.819448 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.819608 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.819763 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.819916 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.820072 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.820217 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.820360 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.820518 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.820664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.820809 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.820963 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.821108 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.821108 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.821402 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.821622 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.821786 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.821940 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.822092 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.822246 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.822391 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.822822 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.822981 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.823127 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.823283 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.823445 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.823600 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.823746 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.823901 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.824053 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.824198 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.824198 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.824494 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.824646 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.824798 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.824943 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.825097 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.825253 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.825406 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.825559 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.825704 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.825866 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.826026 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.826173 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.826325 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.826506 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.826670 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.826815 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.826970 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.827116 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.827262 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.827407 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.827558 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.827702 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.827878 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.828028 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.828172 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.828318 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.828469 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.828613 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.828767 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.828912 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.829073 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.829250 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.829493 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.829729 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.829923 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.830176 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.830413 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.830676 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.830851 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.831018 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.831165 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.831320 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.831466 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.831466 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.831770 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.831770 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.832056 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.832214 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.832367 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.832524 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.832677 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.832849 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.833125 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.833277 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.833422 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.833581 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.833726 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.833872 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.834025 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.834170 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.834335 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.834520 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.834674 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.834831 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.834986 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.834986 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.835488 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.835806 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.836117 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.836429 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.837008 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.837357 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.837702 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.838051 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.838379 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.838743 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.839603 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.839980 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.840147 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.840301 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.840450 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.840639 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.840791 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.840967 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.841128 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.841283 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.841444 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.841596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.841749 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.841911 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.842066 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.842212 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.842386 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.842562 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.842990 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.843375 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.843546 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.843702 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.843860 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.844008 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.844167 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.844324 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.844471 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.844623 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.844777 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.844931 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.845718 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.845931 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.846177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.846428 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.846668 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.846846 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.847003 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.847151 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.847296 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.847448 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.847594 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.847739 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.847739 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.848023 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.848023 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.848317 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.848470 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.848633 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.848797 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.848953 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.849106 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.849260 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.849419 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.849564 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.849722 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.849867 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.850011 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.850162 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.850162 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.850457 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.850639 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.850802 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.850955 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.851118 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.851263 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.851418 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.851563 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.851714 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.851858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.852011 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.852165 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.852317 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.852481 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.852626 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.852770 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.852922 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.853100 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.853455 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.853618 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.853773 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.853919 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.854064 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.854218 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.854371 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.854661 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.854824 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.854976 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.855130 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.855288 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.855444 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.855606 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.855753 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.855908 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.856066 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.856219 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.856364 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.856514 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.856678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.856832 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.856987 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.856987 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.857271 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.857437 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.857592 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.857743 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.857904 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.858065 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.858217 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.858377 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.858562 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.858737 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.858900 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.859060 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.859213 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.859363 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.859514 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.859676 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.859839 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.859998 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.860149 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.860308 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.860460 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.860696 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.861402 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.861642 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.861880 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.862138 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.862318 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.862500 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.862667 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.862816 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.862961 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.862961 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.863271 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.863688 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.863863 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.864011 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.864157 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.864309 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.864465 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.864611 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.864763 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.864917 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.865063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.865063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.865351 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.865504 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.865657 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.865813 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.865960 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.866112 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.866270 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.866270 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.866270 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.866270 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.866825 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.866987 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.867146 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.867146 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.867146 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.867568 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.867711 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.867915 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.868227 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.868540 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.868851 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.869204 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.869519 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.869862 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.870294 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.878503 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.878863 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.879048 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.879248 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.879410 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.879567 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.879722 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.879872 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.880032 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.880194 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.880345 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.880494 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.880642 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.880790 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.880936 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.881092 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.881250 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.881396 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.881541 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.881541 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.881541 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.881987 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.882142 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.882288 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.882440 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.882689 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.882838 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.882998 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.882998 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.883287 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.883434 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.883589 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.883749 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.883947 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.884105 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.884266 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.884419 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.884579 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.884820 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.884976 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.885143 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.885307 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.885467 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.885628 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.885791 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.885944 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.885944 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.885944 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.885944 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.885944 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.885944 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.885944 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.885944 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.887183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.887183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.887183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.887183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.887183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.887183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.887183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.888240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.888240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.888240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.888240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.888240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.888240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.888240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.888240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.889377 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.889377 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.889377 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.889377 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.889377 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.889377 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.889377 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.889377 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.890534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.890534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.890534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.890534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.890534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.890534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.890534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.891703 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.892103 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.892522 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.892873 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.893202 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.893526 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.893867 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.894164 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.894280 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.894516 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.894921 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.895246 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.895498 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.896091 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.896455 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.896759 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.896871 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.897111 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.897449 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.897776 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.898069 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.898182 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.898411 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.898785 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.899103 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.899429 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.899709 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.899811 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.900049 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.900361 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.900679 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.900997 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.901213 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.901314 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.901884 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.902219 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.902570 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.902918 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.903235 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.903550 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.903866 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.903970 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.904183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.904498 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.904808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.905121 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.905359 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.905460 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.905766 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.906075 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.906390 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.906673 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.906790 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.907032 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.907340 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.908182 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.908495 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.908825 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.909159 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.909469 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.909721 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.909823 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.910094 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.910423 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.910764 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.910872 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.911081 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.911435 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.911541 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.911753 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.911850 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.912198 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.912318 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.912588 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.912691 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.912951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.913067 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.913281 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.913389 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.913604 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.913714 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.913925 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.914032 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.914271 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.914623 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.914924 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.915043 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.915239 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.915340 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.915573 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.915673 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.915890 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.916005 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.916210 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.916309 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.916526 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.916626 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.916845 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.916954 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.917160 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.917267 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.917479 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.917588 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.917799 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.917899 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.918120 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.918221 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.918461 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.918940 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.919056 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.919271 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.919379 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.919591 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.919689 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.919911 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.920020 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.920229 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.920338 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.920546 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.920653 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.920865 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.920976 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.921180 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.921283 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.921495 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.921609 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.921801 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.921895 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.922113 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.922275 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.922432 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.922636 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.922816 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.922912 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.923174 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.923801 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.924103 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.924279 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.924432 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.924663 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.924765 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.924987 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.925095 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.925291 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.925385 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.925838 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.925952 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.926243 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.926341 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.926627 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.926791 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.926966 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.927120 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.927283 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.927437 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.927603 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.927764 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.927927 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.928103 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.928264 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.928431 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.928607 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.928761 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.928933 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.929087 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.929482 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.929657 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.929819 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.929981 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.930133 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.930292 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.930463 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.930663 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.930816 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.930976 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.931128 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.931288 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.931449 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.931608 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.931768 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.931932 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.932085 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.932244 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.932484 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.932647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.932807 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.932971 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.933125 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.933277 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.933437 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.933590 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.933748 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.933919 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.934073 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.934225 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.934385 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.934617 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.934773 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.934925 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.935088 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.935261 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.935414 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.935566 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.935736 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.936188 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.936352 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.936515 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.936669 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.936822 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.936986 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.937146 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.937305 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.940642 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.940839 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.941003 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.941160 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.941323 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.941490 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.941644 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.941798 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.941951 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.942126 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.942287 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.942449 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.942642 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.942805 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.942958 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.943110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.943110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.943110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.943565 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.943730 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.943730 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.944042 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.944194 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.944361 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.944514 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.944667 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.944827 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.944988 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.945151 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.945311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.945470 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.945637 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.945799 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.945952 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.946587 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.946755 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.946910 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 03:19:17.947063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.947063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.947063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.947063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.947063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.947063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.947063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.947063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.948209 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 03:19:17.948209 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 03:19:17.966055 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_db.sqlalchemy.engines [None req-721cdbdc-25fc-43bf-9fe1-52e20a941f8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:19:17.968531 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_db.sqlalchemy.engines [None req-213cb6b0-5f6a-454e-a323-e7763ca75cfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:19:18.131311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.context [None req-213cb6b0-5f6a-454e-a323-e7763ca75cfe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f5aef8a-580c-45ec-80bb-74d6e2886ba8(cell1) {{(pid=116065) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 03:19:18.135775 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-213cb6b0-5f6a-454e-a323-e7763ca75cfe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:19:18.137426 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-213cb6b0-5f6a-454e-a323-e7763ca75cfe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:19:18.138184 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-213cb6b0-5f6a-454e-a323-e7763ca75cfe None None] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:19:18.140162 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-213cb6b0-5f6a-454e-a323-e7763ca75cfe None None] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:19:18.141434 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.context [None req-721cdbdc-25fc-43bf-9fe1-52e20a941f8b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f5aef8a-580c-45ec-80bb-74d6e2886ba8(cell1) {{(pid=116066) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 03:19:18.146983 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-721cdbdc-25fc-43bf-9fe1-52e20a941f8b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:19:18.148593 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-721cdbdc-25fc-43bf-9fe1-52e20a941f8b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:19:18.149432 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-721cdbdc-25fc-43bf-9fe1-52e20a941f8b None None] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:19:18.151329 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_db.sqlalchemy.engines [None req-213cb6b0-5f6a-454e-a323-e7763ca75cfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:19:18.151469 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-721cdbdc-25fc-43bf-9fe1-52e20a941f8b None None] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:19:18.152493 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_db.sqlalchemy.engines [None req-213cb6b0-5f6a-454e-a323-e7763ca75cfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:19:18.162720 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_db.sqlalchemy.engines [None req-721cdbdc-25fc-43bf-9fe1-52e20a941f8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:19:18.165501 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_db.sqlalchemy.engines [None req-721cdbdc-25fc-43bf-9fe1-52e20a941f8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:19:18.314268 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_db.sqlalchemy.engines [None req-213cb6b0-5f6a-454e-a323-e7763ca75cfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:19:18.327983 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_db.sqlalchemy.engines [None req-721cdbdc-25fc-43bf-9fe1-52e20a941f8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 03:19:18.641253 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: WARNING keystonemiddleware.auth_token [None req-213cb6b0-5f6a-454e-a323-e7763ca75cfe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 03:19:18.648505 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: WARNING keystonemiddleware.auth_token [None req-213cb6b0-5f6a-454e-a323-e7763ca75cfe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 03:19:18.654302 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: WARNING keystonemiddleware.auth_token [None req-721cdbdc-25fc-43bf-9fe1-52e20a941f8b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 03:19:18.661518 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: WARNING keystonemiddleware.auth_token [None req-721cdbdc-25fc-43bf-9fe1-52e20a941f8b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 03:19:19.005647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: WARNING keystonemiddleware.auth_token [None req-213cb6b0-5f6a-454e-a323-e7763ca75cfe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 03:19:19.007815 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: WARNING keystonemiddleware.auth_token [None req-721cdbdc-25fc-43bf-9fe1-52e20a941f8b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 03:19:19.011190 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: WARNING keystonemiddleware.auth_token [None req-213cb6b0-5f6a-454e-a323-e7763ca75cfe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 03:19:19.012986 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: WARNING keystonemiddleware.auth_token [None req-721cdbdc-25fc-43bf-9fe1-52e20a941f8b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 03:19:19.016630 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581633a89c0 pid: 116065 (default app) Nov 19 03:19:19.019763 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581633a89c0 pid: 116066 (default app) Nov 19 03:19:53.795933 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c79c5dbc-9bd4-4d10-b55f-38d13c6b8e01 tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] Action: 'create', calling method: .version_select at 0x7f845c0845e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-276947886", "metadata": {"Type": "work"}}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:19:53.801802 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c79c5dbc-9bd4-4d10-b55f-38d13c6b8e01 tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:19:53.805345 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c79c5dbc-9bd4-4d10-b55f-38d13c6b8e01 tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.467789 Nov 19 03:19:53.810129 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1155 bytes} [Fri Nov 19 03:19:52 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1470 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 03:19:53.828092 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a9fae1ac-a13c-422e-ae92-eff6a2dfa68a tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] Action: 'create', calling method: .version_select at 0x7f845c0261f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1873131188", "metadata": {"Type": "work"}}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:19:53.834007 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a9fae1ac-a13c-422e-ae92-eff6a2dfa68a tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:19:53.837152 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a9fae1ac-a13c-422e-ae92-eff6a2dfa68a tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025528 Nov 19 03:19:53.841173 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 2/2] 10.222.0.47 () {60 vars in 1155 bytes} [Fri Nov 19 03:19:53 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 03:19:53.859340 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ebf234e8-3d0a-4af2-8ecc-5030af30795c tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] Action: 'create', calling method: .version_select at 0x7f845c084670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1173060088", "metadata": {"Type": "work"}}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:19:53.865525 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ebf234e8-3d0a-4af2-8ecc-5030af30795c tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:19:53.867205 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ebf234e8-3d0a-4af2-8ecc-5030af30795c tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019367 Nov 19 03:19:53.870177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 3/3] 10.222.0.47 () {60 vars in 1155 bytes} [Fri Nov 19 03:19:53 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 03:19:53.894089 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-510276027", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "networks": [{"uuid": "7785fb5c-8c03-4872-a076-a4033ec3cdba"}]}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:19:53.900293 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-229f0adb-d8cc-400e-b638-277b95d196cc tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] Calling method '.version_select at 0x7f845c026ca0>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:19:54.843789 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.network.neutron [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] validate_networks() for [('7785fb5c-8c03-4872-a076-a4033ec3cdba', None, None, None, None, None)] {{(pid=116066) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:19:55.064262 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-229f0adb-d8cc-400e-b638-277b95d196cc tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] HTTP exception thrown: Volume tempest-invalid-1447883334 could not be found. Nov 19 03:19:55.065011 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-229f0adb-d8cc-400e-b638-277b95d196cc tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] Returning 404 to user: Volume tempest-invalid-1447883334 could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:19:55.065908 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-229f0adb-d8cc-400e-b638-277b95d196cc tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1447883334" status: 404 len: 99 microversion: 2.1 time: 1.189893 Nov 19 03:19:55.070664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 4/4] 10.222.0.47 () {58 vars in 1217 bytes} [Fri Nov 19 03:19:53 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1447883334 => generated 99 bytes in 1191 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 19 03:19:55.188169 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-81889808", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "networks": [{"uuid": "cd122154-2aeb-4e66-bcc7-7acf31cd258e"}]}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:19:55.433965 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.network.neutron [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] validate_networks() for [('cd122154-2aeb-4e66-bcc7-7acf31cd258e', None, None, None, None, None)] {{(pid=116065) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:19:56.825901 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Flavor limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:19:56.826441 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Image limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:19:56.827004 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Flavor pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:19:56.827418 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Image pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:19:56.827822 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:19:56.863536 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:19:56.863996 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:19:56.867375 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:19:56.881346 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:19:57.011365 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Getting quotas for project 0b46ab2df10b434fa30ee9c1f01c8e73. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:19:57.021902 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Getting quotas for user 64cb4b68c3b4469e8d23f2398a840f1a and project 0b46ab2df10b434fa30ee9c1f01c8e73. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:19:57.061644 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Going to run 1 instances... {{(pid=116066) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:19:57.074524 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:19:57.235800 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2d1a69ca-e55c-4b42-9d31-1fe3a1a1c94d tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.438542 Nov 19 03:19:57.238256 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 1/5] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:19:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 4443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 03:19:57.252671 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3add1754-d0cf-46bd-9b3f-f5a15c841202 tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012154 Nov 19 03:19:57.253355 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 2/6] 10.222.0.47 () {58 vars in 1139 bytes} [Fri Nov 19 03:19:57 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 19 03:19:57.271771 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1e5eb57f-5c46-4fe0-832e-d1442f2280a5 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:19:57.273262 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1e5eb57f-5c46-4fe0-832e-d1442f2280a5 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:19:57.665342 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Flavor limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:19:57.665946 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Image limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:19:57.666499 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Flavor pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:19:57.667019 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Image pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:19:57.668177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:19:57.729613 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:19:57.730279 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:19:57.734406 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:19:57.737742 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:19:57.908659 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Getting quotas for project 53690eedb4c749db94ed55f64a323cba. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:19:57.938890 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1e5eb57f-5c46-4fe0-832e-d1442f2280a5 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:19:57.940005 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Getting quotas for user 96438e8630f848a8879dbd29e687d1c1 and project 53690eedb4c749db94ed55f64a323cba. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:19:57.969785 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1e5eb57f-5c46-4fe0-832e-d1442f2280a5 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1214 microversion: 2.1 time: 0.712254 Nov 19 03:19:57.974026 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 3/7] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:19:57 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1214 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:19:57.988578 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b2bdce87-233d-4c2c-9b98-7cf6d4807afb tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005699 Nov 19 03:19:57.991415 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1136 bytes} [Fri Nov 19 03:19:57 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 19 03:19:58.009581 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-745b8be0-2724-4452-95d4-95a7b1087b42 tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] Calling method '.version_select at 0x7f845b6a3af0>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:19:58.014816 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Going to run 1 instances... {{(pid=116065) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:19:58.023035 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:19:58.196462 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-745b8be0-2724-4452-95d4-95a7b1087b42 tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] HTTP exception thrown: Volume 6b0a1417-6572-4b66-bb87-ffa5249719bc could not be found. Nov 19 03:19:58.197087 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-745b8be0-2724-4452-95d4-95a7b1087b42 tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] Returning 404 to user: Volume 6b0a1417-6572-4b66-bb87-ffa5249719bc could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:19:58.197951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-745b8be0-2724-4452-95d4-95a7b1087b42 tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/6b0a1417-6572-4b66-bb87-ffa5249719bc" status: 404 len: 109 microversion: 2.1 time: 0.201688 Nov 19 03:19:58.202522 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 5/9] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Nov 19 03:19:57 2021] DELETE /compute/v2.1/os-volumes/6b0a1417-6572-4b66-bb87-ffa5249719bc => generated 109 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:19:58.208677 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-52d7c8e2-18b5-42ee-8538-55538610bfae tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] Calling method '.version_select at 0x7f845ae214c0>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:19:58.241252 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d0e1aa6e-7dd5-4020-9c60-e8481ceaa139 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.173199 Nov 19 03:19:58.254881 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 5/10] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:19:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 3187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:19:58.260153 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e00328ad-4860-459f-a40f-9b10b56c0a0c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:19:58.271662 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e00328ad-4860-459f-a40f-9b10b56c0a0c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:19:58.274764 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-52d7c8e2-18b5-42ee-8538-55538610bfae tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] HTTP exception thrown: Volume 249d6f79-2980-4399-9cdc-5995d194dbf7 could not be found. Nov 19 03:19:58.276037 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-52d7c8e2-18b5-42ee-8538-55538610bfae tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] Returning 404 to user: Volume 249d6f79-2980-4399-9cdc-5995d194dbf7 could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:19:58.278120 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-52d7c8e2-18b5-42ee-8538-55538610bfae tempest-VolumesNegativeTest-1095705385 tempest-VolumesNegativeTest-1095705385-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/249d6f79-2980-4399-9cdc-5995d194dbf7" status: 404 len: 109 microversion: 2.1 time: 0.073590 Nov 19 03:19:58.279900 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 6/11] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:19:58 2021] GET /compute/v2.1/os-volumes/249d6f79-2980-4399-9cdc-5995d194dbf7 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 03:19:58.522684 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e00328ad-4860-459f-a40f-9b10b56c0a0c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:19:58.548604 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e00328ad-4860-459f-a40f-9b10b56c0a0c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1216 microversion: 2.1 time: 0.292186 Nov 19 03:19:58.555474 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:19:58 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1216 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:19:58.987906 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b74c372b-0748-44e4-add6-17e37e3f4241 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:19:58.988854 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b74c372b-0748-44e4-add6-17e37e3f4241 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:19:59.206974 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b74c372b-0748-44e4-add6-17e37e3f4241 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:19:59.218044 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b74c372b-0748-44e4-add6-17e37e3f4241 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1214 microversion: 2.1 time: 0.234142 Nov 19 03:19:59.237096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:19:58 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1214 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:19:59.572908 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-06f039af-59d4-4764-995b-d90ada71465f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:19:59.574252 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-06f039af-59d4-4764-995b-d90ada71465f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:19:59.696746 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-06f039af-59d4-4764-995b-d90ada71465f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:19:59.712639 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-06f039af-59d4-4764-995b-d90ada71465f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1216 microversion: 2.1 time: 0.142090 Nov 19 03:19:59.725107 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 7/14] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:19:59 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:00.239597 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-fe2af27a-5348-45bd-aba3-d217ce3ee09b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:00.241116 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-fe2af27a-5348-45bd-aba3-d217ce3ee09b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:00.252543 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fe2af27a-5348-45bd-aba3-d217ce3ee09b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:00.253828 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fe2af27a-5348-45bd-aba3-d217ce3ee09b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:00.256095 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fe2af27a-5348-45bd-aba3-d217ce3ee09b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:00.256894 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fe2af27a-5348-45bd-aba3-d217ce3ee09b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:00.732924 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-da6f1bcd-83a8-4562-9e0d-9e76a5729bc4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:00.736312 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-da6f1bcd-83a8-4562-9e0d-9e76a5729bc4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:00.747078 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da6f1bcd-83a8-4562-9e0d-9e76a5729bc4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:00.747908 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da6f1bcd-83a8-4562-9e0d-9e76a5729bc4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:00.749006 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da6f1bcd-83a8-4562-9e0d-9e76a5729bc4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:00.751110 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da6f1bcd-83a8-4562-9e0d-9e76a5729bc4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:00.954054 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-fe2af27a-5348-45bd-aba3-d217ce3ee09b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:00.996989 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-fe2af27a-5348-45bd-aba3-d217ce3ee09b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1266 microversion: 2.1 time: 0.762713 Nov 19 03:20:00.997613 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 8/15] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:00 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1266 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:01.297588 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-da6f1bcd-83a8-4562-9e0d-9e76a5729bc4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:01.325076 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-da6f1bcd-83a8-4562-9e0d-9e76a5729bc4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1212 microversion: 2.1 time: 0.598045 Nov 19 03:20:01.326619 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:00 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1212 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:02.015157 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a85bbac7-5392-4cfb-a871-db5f9d786aed tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:02.015973 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a85bbac7-5392-4cfb-a871-db5f9d786aed tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:02.028713 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a85bbac7-5392-4cfb-a871-db5f9d786aed tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:02.029642 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a85bbac7-5392-4cfb-a871-db5f9d786aed tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:02.031015 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a85bbac7-5392-4cfb-a871-db5f9d786aed tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:02.034215 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a85bbac7-5392-4cfb-a871-db5f9d786aed tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:02.149769 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a85bbac7-5392-4cfb-a871-db5f9d786aed tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:02.167668 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a85bbac7-5392-4cfb-a871-db5f9d786aed tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1272 microversion: 2.1 time: 0.156096 Nov 19 03:20:02.176024 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 9/17] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:02 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:02.342820 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0bc4dae1-e5c9-47c9-bc55-55218d4d2bf9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:02.343488 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0bc4dae1-e5c9-47c9-bc55-55218d4d2bf9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:02.356270 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0bc4dae1-e5c9-47c9-bc55-55218d4d2bf9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:02.359983 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0bc4dae1-e5c9-47c9-bc55-55218d4d2bf9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:02.361897 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0bc4dae1-e5c9-47c9-bc55-55218d4d2bf9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:02.364202 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0bc4dae1-e5c9-47c9-bc55-55218d4d2bf9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:02.527480 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0bc4dae1-e5c9-47c9-bc55-55218d4d2bf9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:02.536451 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0bc4dae1-e5c9-47c9-bc55-55218d4d2bf9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1276 microversion: 2.1 time: 0.198001 Nov 19 03:20:02.538960 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 9/18] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:02 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:03.103658 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1408753381", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d12413f-85e7-474c-a155-01fa1c3d890a"}]}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:20:03.193752 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-fd61ad14-72eb-44fe-890f-b72d9c9893b9 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:03.196003 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-fd61ad14-72eb-44fe-890f-b72d9c9893b9 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:03.218723 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fd61ad14-72eb-44fe-890f-b72d9c9893b9 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:03.222539 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.network.neutron [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] validate_networks() for [('4d12413f-85e7-474c-a155-01fa1c3d890a', None, None, None, None, None)] {{(pid=116066) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:20:03.225205 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fd61ad14-72eb-44fe-890f-b72d9c9893b9 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:03.226691 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fd61ad14-72eb-44fe-890f-b72d9c9893b9 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:03.230249 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fd61ad14-72eb-44fe-890f-b72d9c9893b9 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:03.487560 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-fd61ad14-72eb-44fe-890f-b72d9c9893b9 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:03.506277 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-fd61ad14-72eb-44fe-890f-b72d9c9893b9 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1272 microversion: 2.1 time: 0.317326 Nov 19 03:20:03.507287 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 10/19] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:03 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1272 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:03.556600 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f108054a-22fc-4c0c-9bed-83a3f3bf73ee tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:03.557323 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f108054a-22fc-4c0c-9bed-83a3f3bf73ee tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:03.565986 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f108054a-22fc-4c0c-9bed-83a3f3bf73ee tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:03.572156 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f108054a-22fc-4c0c-9bed-83a3f3bf73ee tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:03.573144 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f108054a-22fc-4c0c-9bed-83a3f3bf73ee tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:03.581197 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f108054a-22fc-4c0c-9bed-83a3f3bf73ee tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:03.741832 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f108054a-22fc-4c0c-9bed-83a3f3bf73ee tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:03.750728 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f108054a-22fc-4c0c-9bed-83a3f3bf73ee tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1276 microversion: 2.1 time: 0.197798 Nov 19 03:20:03.751415 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 11/20] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:03 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:04.511801 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Flavor limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:20:04.512260 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Image limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:20:04.512900 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Flavor pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:20:04.513314 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Image pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:20:04.513777 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:20:04.523236 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a471176c-31d0-45b9-b39a-ef84b25b2460 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:04.523842 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a471176c-31d0-45b9-b39a-ef84b25b2460 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:04.533351 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a471176c-31d0-45b9-b39a-ef84b25b2460 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:04.533814 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a471176c-31d0-45b9-b39a-ef84b25b2460 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:04.534347 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:04.534675 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a471176c-31d0-45b9-b39a-ef84b25b2460 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:04.535117 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a471176c-31d0-45b9-b39a-ef84b25b2460 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:04.535407 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:04.536412 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:04.538105 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:04.561297 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Getting quotas for project ee26dbde283f45a58a18f8435596e63e. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:20:04.566341 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Getting quotas for user fd5de23e7d52489dbf22a5e9d5d6a6f9 and project ee26dbde283f45a58a18f8435596e63e. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:20:04.580547 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Going to run 1 instances... {{(pid=116066) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:20:04.583793 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:20:04.676155 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-fc135ec9-f487-49db-8191-5d078f959c34 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.114653 Nov 19 03:20:04.677697 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 10/21] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:20:02 2021] POST /compute/v2.1/servers => generated 383 bytes in 2117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:20:04.687314 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-bb553d0e-0afa-4fea-8f1f-ed0bf94bffb7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:04.689013 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-bb553d0e-0afa-4fea-8f1f-ed0bf94bffb7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:04.787447 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a471176c-31d0-45b9-b39a-ef84b25b2460 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:04.801496 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a471176c-31d0-45b9-b39a-ef84b25b2460 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1272 microversion: 2.1 time: 0.280959 Nov 19 03:20:04.804151 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 12/22] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:04 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1272 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:04.821420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4b22ee3a-3606-4d54-8a0a-4f0b88a35ce2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:04.823275 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4b22ee3a-3606-4d54-8a0a-4f0b88a35ce2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:04.860314 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4b22ee3a-3606-4d54-8a0a-4f0b88a35ce2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:04.861897 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4b22ee3a-3606-4d54-8a0a-4f0b88a35ce2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:04.864701 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4b22ee3a-3606-4d54-8a0a-4f0b88a35ce2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:04.865742 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4b22ee3a-3606-4d54-8a0a-4f0b88a35ce2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:04.933301 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-bb553d0e-0afa-4fea-8f1f-ed0bf94bffb7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:04.944340 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-bb553d0e-0afa-4fea-8f1f-ed0bf94bffb7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1222 microversion: 2.1 time: 0.260666 Nov 19 03:20:04.949443 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 11/23] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:04 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1222 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:05.061919 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4b22ee3a-3606-4d54-8a0a-4f0b88a35ce2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:05.070665 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4b22ee3a-3606-4d54-8a0a-4f0b88a35ce2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1276 microversion: 2.1 time: 0.264509 Nov 19 03:20:05.082828 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 13/24] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:04 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1276 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:05.401302 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1677041671", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d12413f-85e7-474c-a155-01fa1c3d890a"}]}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:20:05.545990 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.network.neutron [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] validate_networks() for [('4d12413f-85e7-474c-a155-01fa1c3d890a', None, None, None, None, None)] {{(pid=116065) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:20:05.856669 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2657c42f-d327-4fcc-8aa2-3745932d5d07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'create', calling method: .version_select at 0x7f845adac940>, body: {"keypair": {"name": "tempest-keypair-731532775"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:20:05.897950 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-2657c42f-d327-4fcc-8aa2-3745932d5d07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Getting quotas for project fcaf6436c60844aaba3497db6db06391. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:20:05.903776 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-2657c42f-d327-4fcc-8aa2-3745932d5d07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Getting quotas for user 7badb98be6a6455c804f8960482cdceb and project fcaf6436c60844aaba3497db6db06391. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:20:06.604516 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Flavor limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:20:06.605026 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Image limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:20:06.605413 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Flavor pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:20:06.606076 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Image pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:20:06.606449 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:20:06.642882 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:06.646847 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:06.653910 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:06.655532 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:06.706811 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Getting quotas for project ee26dbde283f45a58a18f8435596e63e. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:20:06.719539 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Getting quotas for user fd5de23e7d52489dbf22a5e9d5d6a6f9 and project ee26dbde283f45a58a18f8435596e63e. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:20:06.779233 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Going to run 1 instances... {{(pid=116065) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:20:06.790124 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:20:06.997367 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-2657c42f-d327-4fcc-8aa2-3745932d5d07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Getting quotas for project fcaf6436c60844aaba3497db6db06391. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:20:07.013822 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-2657c42f-d327-4fcc-8aa2-3745932d5d07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Getting quotas for user 7badb98be6a6455c804f8960482cdceb and project fcaf6436c60844aaba3497db6db06391. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:20:07.034830 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a1267551-2b6d-4d38-9583-76927d758364 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.637764 Nov 19 03:20:07.038244 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 14/25] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:20:05 2021] POST /compute/v2.1/servers => generated 383 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:20:07.071919 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-71c968a5-e23f-4caa-80cc-dc42ec0f361f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:07.084926 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-71c968a5-e23f-4caa-80cc-dc42ec0f361f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:07.105293 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71c968a5-e23f-4caa-80cc-dc42ec0f361f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:07.105757 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71c968a5-e23f-4caa-80cc-dc42ec0f361f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:07.108029 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2657c42f-d327-4fcc-8aa2-3745932d5d07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.843827 Nov 19 03:20:07.112574 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71c968a5-e23f-4caa-80cc-dc42ec0f361f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:07.113262 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71c968a5-e23f-4caa-80cc-dc42ec0f361f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:07.124883 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 12/26] 10.222.0.47 () {62 vars in 1198 bytes} [Fri Nov 19 03:20:05 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1862 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 19 03:20:07.152632 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-079dca28-ce80-425d-b154-a1b264d9119c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:07.153271 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-079dca28-ce80-425d-b154-a1b264d9119c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:07.180453 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-079dca28-ce80-425d-b154-a1b264d9119c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:07.184513 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-079dca28-ce80-425d-b154-a1b264d9119c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:07.186167 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-079dca28-ce80-425d-b154-a1b264d9119c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:07.186662 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-079dca28-ce80-425d-b154-a1b264d9119c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:07.502839 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-71c968a5-e23f-4caa-80cc-dc42ec0f361f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:07.517206 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-71c968a5-e23f-4caa-80cc-dc42ec0f361f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1272 microversion: 2.1 time: 0.476844 Nov 19 03:20:07.518125 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 15/27] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:07 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1272 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:07.540072 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3e263170-0daa-4c44-a1b4-550a15dc6c2c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:07.541175 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3e263170-0daa-4c44-a1b4-550a15dc6c2c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:07.830380 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-079dca28-ce80-425d-b154-a1b264d9119c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:07.845441 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-079dca28-ce80-425d-b154-a1b264d9119c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1274 microversion: 2.1 time: 0.715022 Nov 19 03:20:07.852440 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 13/28] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:07 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1274 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:07.917376 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3e263170-0daa-4c44-a1b4-550a15dc6c2c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:07.945052 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3e263170-0daa-4c44-a1b4-550a15dc6c2c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1222 microversion: 2.1 time: 0.422227 Nov 19 03:20:07.948855 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 16/29] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:07 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1222 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:08.540013 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-243d9784-1b8a-4676-9acf-919f78559c95 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:08.543761 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-243d9784-1b8a-4676-9acf-919f78559c95 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:08.555543 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-243d9784-1b8a-4676-9acf-919f78559c95 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:08.556326 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-243d9784-1b8a-4676-9acf-919f78559c95 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:08.577409 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-243d9784-1b8a-4676-9acf-919f78559c95 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:08.579221 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-243d9784-1b8a-4676-9acf-919f78559c95 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:08.863280 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7653a166-e3dd-444f-adec-c0dc8524cf5b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:08.863891 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7653a166-e3dd-444f-adec-c0dc8524cf5b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:08.880147 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7653a166-e3dd-444f-adec-c0dc8524cf5b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:08.880598 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7653a166-e3dd-444f-adec-c0dc8524cf5b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:08.881392 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7653a166-e3dd-444f-adec-c0dc8524cf5b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:08.881825 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7653a166-e3dd-444f-adec-c0dc8524cf5b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:09.254686 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-243d9784-1b8a-4676-9acf-919f78559c95 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:09.303559 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-243d9784-1b8a-4676-9acf-919f78559c95 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1272 microversion: 2.1 time: 0.757217 Nov 19 03:20:09.310318 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 14/30] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:08 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1272 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:09.353077 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-aec7abfd-06c9-4389-9ea8-e58fee8818eb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:09.356945 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-aec7abfd-06c9-4389-9ea8-e58fee8818eb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:09.373436 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aec7abfd-06c9-4389-9ea8-e58fee8818eb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:09.374251 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aec7abfd-06c9-4389-9ea8-e58fee8818eb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:09.375675 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aec7abfd-06c9-4389-9ea8-e58fee8818eb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:09.376570 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aec7abfd-06c9-4389-9ea8-e58fee8818eb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:09.519025 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7653a166-e3dd-444f-adec-c0dc8524cf5b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:09.549566 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7653a166-e3dd-444f-adec-c0dc8524cf5b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1274 microversion: 2.1 time: 0.690447 Nov 19 03:20:09.550153 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 17/31] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:08 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1274 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:09.598449 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-aec7abfd-06c9-4389-9ea8-e58fee8818eb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:09.610792 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-aec7abfd-06c9-4389-9ea8-e58fee8818eb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1274 microversion: 2.1 time: 0.293408 Nov 19 03:20:09.612835 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 15/32] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:09 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1274 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:10.327930 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f378b65f-102b-412b-ac8f-19525e1a69e2 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:10.329230 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f378b65f-102b-412b-ac8f-19525e1a69e2 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:10.340195 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f378b65f-102b-412b-ac8f-19525e1a69e2 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:10.342139 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f378b65f-102b-412b-ac8f-19525e1a69e2 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:10.343290 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f378b65f-102b-412b-ac8f-19525e1a69e2 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:10.344848 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f378b65f-102b-412b-ac8f-19525e1a69e2 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:10.566457 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e8a15d77-9fbe-4d7d-86c3-3db7b98cee85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:10.567519 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e8a15d77-9fbe-4d7d-86c3-3db7b98cee85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:10.577922 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e8a15d77-9fbe-4d7d-86c3-3db7b98cee85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:10.579575 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e8a15d77-9fbe-4d7d-86c3-3db7b98cee85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:10.581592 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e8a15d77-9fbe-4d7d-86c3-3db7b98cee85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:10.583090 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e8a15d77-9fbe-4d7d-86c3-3db7b98cee85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:11.369818 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e8a15d77-9fbe-4d7d-86c3-3db7b98cee85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:11.387025 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e8a15d77-9fbe-4d7d-86c3-3db7b98cee85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1274 microversion: 2.1 time: 0.821284 Nov 19 03:20:11.407730 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 16/33] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:10 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1274 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:11.412104 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-248f728b-11a0-4eef-b382-2b586ebc2098 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:11.412814 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-248f728b-11a0-4eef-b382-2b586ebc2098 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:11.442543 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-248f728b-11a0-4eef-b382-2b586ebc2098 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:11.443115 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-248f728b-11a0-4eef-b382-2b586ebc2098 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:11.444055 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-248f728b-11a0-4eef-b382-2b586ebc2098 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:11.444423 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-248f728b-11a0-4eef-b382-2b586ebc2098 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:11.707851 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-248f728b-11a0-4eef-b382-2b586ebc2098 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:11.730347 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-248f728b-11a0-4eef-b382-2b586ebc2098 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1274 microversion: 2.1 time: 0.321359 Nov 19 03:20:11.731548 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 17/34] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:11 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1274 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:11.821008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f378b65f-102b-412b-ac8f-19525e1a69e2 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:11.842346 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f378b65f-102b-412b-ac8f-19525e1a69e2 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 1.510870 Nov 19 03:20:11.853068 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 18/35] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:10 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:12.417030 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5c59f702-fddd-4b0e-bc60-93034b80b5c3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:12.423799 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5c59f702-fddd-4b0e-bc60-93034b80b5c3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:12.446189 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5c59f702-fddd-4b0e-bc60-93034b80b5c3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:12.472717 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5c59f702-fddd-4b0e-bc60-93034b80b5c3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:12.476178 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5c59f702-fddd-4b0e-bc60-93034b80b5c3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:12.476839 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5c59f702-fddd-4b0e-bc60-93034b80b5c3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:12.747983 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1607b691-4fe2-45d4-8b55-dbfe607ced91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:12.748903 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1607b691-4fe2-45d4-8b55-dbfe607ced91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:12.767554 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1607b691-4fe2-45d4-8b55-dbfe607ced91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:12.769548 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1607b691-4fe2-45d4-8b55-dbfe607ced91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:12.776768 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1607b691-4fe2-45d4-8b55-dbfe607ced91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:12.783888 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1607b691-4fe2-45d4-8b55-dbfe607ced91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:13.132085 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1607b691-4fe2-45d4-8b55-dbfe607ced91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:13.142212 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1607b691-4fe2-45d4-8b55-dbfe607ced91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1274 microversion: 2.1 time: 0.398257 Nov 19 03:20:13.149833 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 19/36] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:12 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1274 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:13.169575 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-21394188-945b-452d-a88c-7b1d066b8bb5 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:13.172182 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-21394188-945b-452d-a88c-7b1d066b8bb5 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:13.199206 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-21394188-945b-452d-a88c-7b1d066b8bb5 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:13.201414 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-21394188-945b-452d-a88c-7b1d066b8bb5 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:13.204607 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-21394188-945b-452d-a88c-7b1d066b8bb5 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:13.208007 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-21394188-945b-452d-a88c-7b1d066b8bb5 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:13.791035 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5c59f702-fddd-4b0e-bc60-93034b80b5c3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:13.808278 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5c59f702-fddd-4b0e-bc60-93034b80b5c3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 1.399961 Nov 19 03:20:13.818893 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 18/37] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:12 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:14.104381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-21394188-945b-452d-a88c-7b1d066b8bb5 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:14.112639 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-21394188-945b-452d-a88c-7b1d066b8bb5 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.961681 Nov 19 03:20:14.123152 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 20/38] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:13 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:14.166722 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d82f2ede-4400-451c-a4a0-7c98adbe9ae4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:14.167591 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d82f2ede-4400-451c-a4a0-7c98adbe9ae4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:14.182106 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d82f2ede-4400-451c-a4a0-7c98adbe9ae4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:14.185039 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d82f2ede-4400-451c-a4a0-7c98adbe9ae4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:14.186018 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d82f2ede-4400-451c-a4a0-7c98adbe9ae4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:14.191160 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d82f2ede-4400-451c-a4a0-7c98adbe9ae4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:14.837597 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5fab74f2-665d-4496-89f2-9d27f7221853 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:14.839857 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5fab74f2-665d-4496-89f2-9d27f7221853 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:14.868243 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5fab74f2-665d-4496-89f2-9d27f7221853 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:14.868662 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5fab74f2-665d-4496-89f2-9d27f7221853 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:14.869278 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5fab74f2-665d-4496-89f2-9d27f7221853 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:14.869798 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5fab74f2-665d-4496-89f2-9d27f7221853 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:15.240552 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d82f2ede-4400-451c-a4a0-7c98adbe9ae4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:15.269896 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d82f2ede-4400-451c-a4a0-7c98adbe9ae4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1280 microversion: 2.1 time: 1.103842 Nov 19 03:20:15.270942 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 19/39] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:14 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1280 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:15.276403 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f58af5da-6810-4fd9-a35f-7c331d15ba3b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:15.281320 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f58af5da-6810-4fd9-a35f-7c331d15ba3b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:15.297682 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f58af5da-6810-4fd9-a35f-7c331d15ba3b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:15.303491 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f58af5da-6810-4fd9-a35f-7c331d15ba3b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:15.304703 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f58af5da-6810-4fd9-a35f-7c331d15ba3b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:15.305412 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f58af5da-6810-4fd9-a35f-7c331d15ba3b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:16.122225 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5fab74f2-665d-4496-89f2-9d27f7221853 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:16.134792 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5fab74f2-665d-4496-89f2-9d27f7221853 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 1.303118 Nov 19 03:20:16.141485 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 21/40] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:14 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:16.291000 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3b6b1692-14c6-4b6e-99c2-2be1468fe5e9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:16.292194 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3b6b1692-14c6-4b6e-99c2-2be1468fe5e9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:16.324371 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3b6b1692-14c6-4b6e-99c2-2be1468fe5e9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:16.328103 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3b6b1692-14c6-4b6e-99c2-2be1468fe5e9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:16.336316 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3b6b1692-14c6-4b6e-99c2-2be1468fe5e9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:16.337350 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3b6b1692-14c6-4b6e-99c2-2be1468fe5e9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:16.413908 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-f58af5da-6810-4fd9-a35f-7c331d15ba3b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:16.451882 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f58af5da-6810-4fd9-a35f-7c331d15ba3b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 1.177671 Nov 19 03:20:16.454316 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 20/41] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:15 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:16.684500 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3b6b1692-14c6-4b6e-99c2-2be1468fe5e9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:16.694026 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3b6b1692-14c6-4b6e-99c2-2be1468fe5e9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1280 microversion: 2.1 time: 0.409026 Nov 19 03:20:16.694687 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 22/42] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:16 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1280 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:17.172169 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c31a2e11-df6c-403b-9e43-bde5b41ad9af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:17.173200 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c31a2e11-df6c-403b-9e43-bde5b41ad9af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:17.185215 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c31a2e11-df6c-403b-9e43-bde5b41ad9af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:17.188460 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c31a2e11-df6c-403b-9e43-bde5b41ad9af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:17.189508 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c31a2e11-df6c-403b-9e43-bde5b41ad9af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:17.190987 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c31a2e11-df6c-403b-9e43-bde5b41ad9af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:17.472172 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0f2872b0-1722-4f3f-ab09-1ab27ee3dee0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:17.472966 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0f2872b0-1722-4f3f-ab09-1ab27ee3dee0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:17.494044 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0f2872b0-1722-4f3f-ab09-1ab27ee3dee0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:17.494535 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0f2872b0-1722-4f3f-ab09-1ab27ee3dee0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:17.495347 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0f2872b0-1722-4f3f-ab09-1ab27ee3dee0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:17.495967 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0f2872b0-1722-4f3f-ab09-1ab27ee3dee0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:18.587517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0f2872b0-1722-4f3f-ab09-1ab27ee3dee0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:18.602508 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0f2872b0-1722-4f3f-ab09-1ab27ee3dee0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 1.133248 Nov 19 03:20:18.604379 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 23/43] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:17 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:18.717457 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c31a2e11-df6c-403b-9e43-bde5b41ad9af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:18.731883 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c31a2e11-df6c-403b-9e43-bde5b41ad9af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 1.578299 Nov 19 03:20:18.743621 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 21/44] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:17 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:18.763873 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-db48a130-9371-4a29-929b-07eb2555cae4 req-dcfef83d-0ea1-4977-a2dc-afb2f0fafa4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c2fd56f-4c3a-4229-9b89-1f4c765c04d4", "tag": "e9c16595-10bc-456b-bed0-df7470f9741d"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:20:18.766908 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:20:18.766908 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:20:18.772343 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-fbf202e5-2141-4cc1-880d-f28516c3ba1b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:18.773462 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-fbf202e5-2141-4cc1-880d-f28516c3ba1b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:18.782013 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fbf202e5-2141-4cc1-880d-f28516c3ba1b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:18.783030 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fbf202e5-2141-4cc1-880d-f28516c3ba1b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:18.784233 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fbf202e5-2141-4cc1-880d-f28516c3ba1b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:18.784965 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fbf202e5-2141-4cc1-880d-f28516c3ba1b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:18.793842 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-db48a130-9371-4a29-929b-07eb2555cae4 req-dcfef83d-0ea1-4977-a2dc-afb2f0fafa4e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:18.794282 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-db48a130-9371-4a29-929b-07eb2555cae4 req-dcfef83d-0ea1-4977-a2dc-afb2f0fafa4e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:18.850118 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-db48a130-9371-4a29-929b-07eb2555cae4 req-dcfef83d-0ea1-4977-a2dc-afb2f0fafa4e service nova] Creating event network-changed:e9c16595-10bc-456b-bed0-df7470f9741d for instance 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 on hv-cinder-81803 Nov 19 03:20:18.850685 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-db48a130-9371-4a29-929b-07eb2555cae4 req-dcfef83d-0ea1-4977-a2dc-afb2f0fafa4e service nova] Acquired lock "compute-rpcapi-router" {{(pid=116065) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 19 03:20:18.857086 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-33f7c849-7f3d-4b5d-bd05-9d8eebfcf9d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:18.857975 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-33f7c849-7f3d-4b5d-bd05-9d8eebfcf9d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:18.861124 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-33f7c849-7f3d-4b5d-bd05-9d8eebfcf9d8 None None] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:18.866265 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-33f7c849-7f3d-4b5d-bd05-9d8eebfcf9d8 None None] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:18.885311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.compute.rpcapi [None req-33f7c849-7f3d-4b5d-bd05-9d8eebfcf9d8 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 19 03:20:18.885311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-33f7c849-7f3d-4b5d-bd05-9d8eebfcf9d8 None None] Releasing lock "compute-rpcapi-router" {{(pid=116065) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 19 03:20:18.988952 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-33f7c849-7f3d-4b5d-bd05-9d8eebfcf9d8 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.382988 Nov 19 03:20:18.989791 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 24/45] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:20:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:20:19.278694 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-fbf202e5-2141-4cc1-880d-f28516c3ba1b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:19.287257 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-fbf202e5-2141-4cc1-880d-f28516c3ba1b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.542501 Nov 19 03:20:19.288262 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 22/46] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:18 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:19.295180 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-816035326", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc33bde6-1f11-4e70-b114-c741f5e152cf"}], "security_groups": [{"name": "tempest-securitygroup--1781642727"}], "key_name": "tempest-keypair-731532775", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:20:19.314764 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-9495f98f-cb29-4fa6-bdcb-0ab12b91a1aa req-5da8f2d9-3526-41d9-be9a-2ebbc0617b26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9ce8291-c6df-4afe-a958-5b8ef4c447fd", "tag": "564d4434-0349-4ca0-a3f4-f36410053f5a"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:20:19.317274 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:20:19.317274 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:20:19.325725 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-9495f98f-cb29-4fa6-bdcb-0ab12b91a1aa req-5da8f2d9-3526-41d9-be9a-2ebbc0617b26 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:19.326515 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-9495f98f-cb29-4fa6-bdcb-0ab12b91a1aa req-5da8f2d9-3526-41d9-be9a-2ebbc0617b26 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:19.345293 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-9495f98f-cb29-4fa6-bdcb-0ab12b91a1aa req-5da8f2d9-3526-41d9-be9a-2ebbc0617b26 service nova] Creating event network-changed:564d4434-0349-4ca0-a3f4-f36410053f5a for instance c9ce8291-c6df-4afe-a958-5b8ef4c447fd on hv-cinder-81803 Nov 19 03:20:19.352476 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-9495f98f-cb29-4fa6-bdcb-0ab12b91a1aa req-5da8f2d9-3526-41d9-be9a-2ebbc0617b26 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.312946 Nov 19 03:20:19.353436 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 25/47] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:20:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:20:19.475291 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.network.neutron [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] validate_networks() for [('dc33bde6-1f11-4e70-b114-c741f5e152cf', None, None, None, None, None)] {{(pid=116066) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:20:19.624478 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d876ad52-dda3-4666-866b-6941f5dbb951 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:19.625800 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d876ad52-dda3-4666-866b-6941f5dbb951 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:19.638236 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d876ad52-dda3-4666-866b-6941f5dbb951 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:19.641261 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d876ad52-dda3-4666-866b-6941f5dbb951 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:19.643834 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d876ad52-dda3-4666-866b-6941f5dbb951 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:19.644299 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d876ad52-dda3-4666-866b-6941f5dbb951 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:19.934008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d876ad52-dda3-4666-866b-6941f5dbb951 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:19.944746 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d876ad52-dda3-4666-866b-6941f5dbb951 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.324561 Nov 19 03:20:19.945723 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 26/48] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:19 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:19.961287 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-96537ce4-ee5c-4bf7-bb1f-81c17fac9038 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:19.962276 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-96537ce4-ee5c-4bf7-bb1f-81c17fac9038 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:19.971490 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-96537ce4-ee5c-4bf7-bb1f-81c17fac9038 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:19.972138 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-96537ce4-ee5c-4bf7-bb1f-81c17fac9038 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:19.973732 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-96537ce4-ee5c-4bf7-bb1f-81c17fac9038 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:19.974458 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-96537ce4-ee5c-4bf7-bb1f-81c17fac9038 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:20.285354 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-96537ce4-ee5c-4bf7-bb1f-81c17fac9038 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:20.293425 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-96537ce4-ee5c-4bf7-bb1f-81c17fac9038 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.343901 Nov 19 03:20:20.294772 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 27/49] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:19 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:20.306295 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-253d2380-30b8-4b47-8054-5b8b9e930439 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:20.307466 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-253d2380-30b8-4b47-8054-5b8b9e930439 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:20.313573 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Flavor limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:20:20.314111 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Image limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:20:20.314834 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Flavor pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:20:20.315519 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Image pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:20:20.316145 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:20:20.318428 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-253d2380-30b8-4b47-8054-5b8b9e930439 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:20.318917 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-253d2380-30b8-4b47-8054-5b8b9e930439 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:20.319704 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-253d2380-30b8-4b47-8054-5b8b9e930439 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:20.320192 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-253d2380-30b8-4b47-8054-5b8b9e930439 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:20.327199 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:20.328358 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:20.329418 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:20.329867 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:20.356353 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Getting quotas for project fcaf6436c60844aaba3497db6db06391. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:20:20.362581 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Getting quotas for user 7badb98be6a6455c804f8960482cdceb and project fcaf6436c60844aaba3497db6db06391. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:20:20.380041 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Going to run 1 instances... {{(pid=116066) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:20:20.381808 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:20:20.452412 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-be95b3d2-b61a-4b2c-ad27-63b226ec9373 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.162625 Nov 19 03:20:20.454342 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 23/50] 10.222.0.47 () {62 vars in 1187 bytes} [Fri Nov 19 03:20:19 2021] POST /compute/v2.1/servers => generated 402 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 19 03:20:20.464794 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-27128761-636c-4be5-af0a-b44ee46af182 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:20.465584 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-27128761-636c-4be5-af0a-b44ee46af182 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:20.512213 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-253d2380-30b8-4b47-8054-5b8b9e930439 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:20.526654 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-253d2380-30b8-4b47-8054-5b8b9e930439 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.221158 Nov 19 03:20:20.527863 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 28/51] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:20 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:20.568321 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-27128761-636c-4be5-af0a-b44ee46af182 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:20.580559 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-27128761-636c-4be5-af0a-b44ee46af182 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:20.582760 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-27128761-636c-4be5-af0a-b44ee46af182 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:20.584262 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-27128761-636c-4be5-af0a-b44ee46af182 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1280 microversion: 2.20 time: 0.124080 Nov 19 03:20:20.584889 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 24/52] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:20 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1280 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:20:20.962629 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-cbf58b83-942e-4edb-90b5-ace343de04df tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:20.964212 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-cbf58b83-942e-4edb-90b5-ace343de04df tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:20.972191 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cbf58b83-942e-4edb-90b5-ace343de04df tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:20.972941 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cbf58b83-942e-4edb-90b5-ace343de04df tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:20.973814 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cbf58b83-942e-4edb-90b5-ace343de04df tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:20.974358 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cbf58b83-942e-4edb-90b5-ace343de04df tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:21.016413 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-45357c53-51c3-417c-8bcf-8f8a911ba3fe req-cd847350-29ad-468c-b763-fc9ffa0161f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19ae39a-79ce-4adb-9ee4-595daa1a8d27", "tag": "f3a1472b-becd-4a09-9300-3ef891038626"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:20:21.018770 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:20:21.018770 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:20:21.031716 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-45357c53-51c3-417c-8bcf-8f8a911ba3fe req-cd847350-29ad-468c-b763-fc9ffa0161f5 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:21.032988 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-45357c53-51c3-417c-8bcf-8f8a911ba3fe req-cd847350-29ad-468c-b763-fc9ffa0161f5 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:21.066241 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-45357c53-51c3-417c-8bcf-8f8a911ba3fe req-cd847350-29ad-468c-b763-fc9ffa0161f5 service nova] Creating event network-changed:f3a1472b-becd-4a09-9300-3ef891038626 for instance b19ae39a-79ce-4adb-9ee4-595daa1a8d27 on hv-cinder-81803 Nov 19 03:20:21.067479 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-45357c53-51c3-417c-8bcf-8f8a911ba3fe req-cd847350-29ad-468c-b763-fc9ffa0161f5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116066) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 19 03:20:21.075481 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4b09e8dd-4b11-4461-b27c-ecb8bb93acb8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:21.076460 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4b09e8dd-4b11-4461-b27c-ecb8bb93acb8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:21.077568 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4b09e8dd-4b11-4461-b27c-ecb8bb93acb8 None None] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:21.078854 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4b09e8dd-4b11-4461-b27c-ecb8bb93acb8 None None] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:21.092640 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.compute.rpcapi [None req-4b09e8dd-4b11-4461-b27c-ecb8bb93acb8 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 19 03:20:21.094296 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4b09e8dd-4b11-4461-b27c-ecb8bb93acb8 None None] Releasing lock "compute-rpcapi-router" {{(pid=116066) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 19 03:20:21.149988 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4b09e8dd-4b11-4461-b27c-ecb8bb93acb8 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136718 Nov 19 03:20:21.152567 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 25/53] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:20:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:20:21.226104 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-cbf58b83-942e-4edb-90b5-ace343de04df tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:21.241470 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-cbf58b83-942e-4edb-90b5-ace343de04df tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.280197 Nov 19 03:20:21.243777 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 29/54] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:20 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:21.312790 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-bf5185be-5dca-499e-8bcb-e8e4b089ed85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:21.313802 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-bf5185be-5dca-499e-8bcb-e8e4b089ed85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:21.327770 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bf5185be-5dca-499e-8bcb-e8e4b089ed85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:21.328234 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bf5185be-5dca-499e-8bcb-e8e4b089ed85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:21.329040 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bf5185be-5dca-499e-8bcb-e8e4b089ed85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:21.333752 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bf5185be-5dca-499e-8bcb-e8e4b089ed85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:21.544333 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c526926e-1d45-451d-97b8-39cd238034b9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:21.544945 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c526926e-1d45-451d-97b8-39cd238034b9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:21.561525 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c526926e-1d45-451d-97b8-39cd238034b9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:21.563635 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c526926e-1d45-451d-97b8-39cd238034b9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:21.565311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c526926e-1d45-451d-97b8-39cd238034b9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:21.566363 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c526926e-1d45-451d-97b8-39cd238034b9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:21.577567 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-bf5185be-5dca-499e-8bcb-e8e4b089ed85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:21.585862 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-bf5185be-5dca-499e-8bcb-e8e4b089ed85 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.277943 Nov 19 03:20:21.594750 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 26/55] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:21 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:21.605222 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a58c65db-08a6-4ac5-993c-e0140c07f560 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:21.606881 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a58c65db-08a6-4ac5-993c-e0140c07f560 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:21.622951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a58c65db-08a6-4ac5-993c-e0140c07f560 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:21.623412 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a58c65db-08a6-4ac5-993c-e0140c07f560 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:21.624881 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a58c65db-08a6-4ac5-993c-e0140c07f560 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:21.625513 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a58c65db-08a6-4ac5-993c-e0140c07f560 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:21.713247 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a58c65db-08a6-4ac5-993c-e0140c07f560 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:21.729430 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a58c65db-08a6-4ac5-993c-e0140c07f560 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:21.730943 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a58c65db-08a6-4ac5-993c-e0140c07f560 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:21.732042 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a58c65db-08a6-4ac5-993c-e0140c07f560 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1284 microversion: 2.20 time: 0.133975 Nov 19 03:20:21.732604 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 27/56] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:21 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:21.789960 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c526926e-1d45-451d-97b8-39cd238034b9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:21.812926 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c526926e-1d45-451d-97b8-39cd238034b9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.271567 Nov 19 03:20:21.814049 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 30/57] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:21 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:22.278138 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-09e5c90f-87a2-4e26-9866-10f1dafe7052 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:22.279146 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-09e5c90f-87a2-4e26-9866-10f1dafe7052 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:22.287578 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09e5c90f-87a2-4e26-9866-10f1dafe7052 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:22.288059 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09e5c90f-87a2-4e26-9866-10f1dafe7052 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:22.289711 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09e5c90f-87a2-4e26-9866-10f1dafe7052 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:22.290163 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09e5c90f-87a2-4e26-9866-10f1dafe7052 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:22.605403 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9ebecd64-2531-4256-9647-1270f1cbdffa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:22.606748 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9ebecd64-2531-4256-9647-1270f1cbdffa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:22.620338 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9ebecd64-2531-4256-9647-1270f1cbdffa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:22.621164 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9ebecd64-2531-4256-9647-1270f1cbdffa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:22.622122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9ebecd64-2531-4256-9647-1270f1cbdffa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:22.622664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9ebecd64-2531-4256-9647-1270f1cbdffa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:23.262328 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-09e5c90f-87a2-4e26-9866-10f1dafe7052 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:23.276814 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-09e5c90f-87a2-4e26-9866-10f1dafe7052 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 1.014973 Nov 19 03:20:23.278874 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 28/58] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:22 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:23.306740 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c1a2e5c2-3342-45b9-8cc5-06e5aa5c60b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:23.307691 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c1a2e5c2-3342-45b9-8cc5-06e5aa5c60b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:23.334696 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c1a2e5c2-3342-45b9-8cc5-06e5aa5c60b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:23.339051 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c1a2e5c2-3342-45b9-8cc5-06e5aa5c60b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:23.340090 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c1a2e5c2-3342-45b9-8cc5-06e5aa5c60b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:23.340563 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c1a2e5c2-3342-45b9-8cc5-06e5aa5c60b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:23.600633 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9ebecd64-2531-4256-9647-1270f1cbdffa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:23.608710 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9ebecd64-2531-4256-9647-1270f1cbdffa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 1.009038 Nov 19 03:20:23.619784 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 31/59] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:22 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:23.625579 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-fcbfd9c3-ea2e-4794-9b8c-d634ccff1c28 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:23.627054 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-fcbfd9c3-ea2e-4794-9b8c-d634ccff1c28 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:23.633762 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fcbfd9c3-ea2e-4794-9b8c-d634ccff1c28 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:23.634412 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fcbfd9c3-ea2e-4794-9b8c-d634ccff1c28 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:23.635448 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fcbfd9c3-ea2e-4794-9b8c-d634ccff1c28 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:23.636048 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fcbfd9c3-ea2e-4794-9b8c-d634ccff1c28 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:23.745802 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c1a2e5c2-3342-45b9-8cc5-06e5aa5c60b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:23.755315 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c1a2e5c2-3342-45b9-8cc5-06e5aa5c60b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:23.756800 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c1a2e5c2-3342-45b9-8cc5-06e5aa5c60b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:23.757900 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c1a2e5c2-3342-45b9-8cc5-06e5aa5c60b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1350 microversion: 2.20 time: 0.464035 Nov 19 03:20:23.764025 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 29/60] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:23 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1350 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:24.231136 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-fcbfd9c3-ea2e-4794-9b8c-d634ccff1c28 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:24.243308 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-fcbfd9c3-ea2e-4794-9b8c-d634ccff1c28 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.621687 Nov 19 03:20:24.253969 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 32/61] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:23 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:24.295929 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-53851b26-cd9c-4119-bf77-70366898f7f0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:24.297231 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-53851b26-cd9c-4119-bf77-70366898f7f0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:24.305572 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-53851b26-cd9c-4119-bf77-70366898f7f0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:24.306983 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-53851b26-cd9c-4119-bf77-70366898f7f0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:24.308528 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-53851b26-cd9c-4119-bf77-70366898f7f0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:24.309212 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-53851b26-cd9c-4119-bf77-70366898f7f0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:24.631100 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8e521171-a42e-48b9-82d3-3eb5d6df259d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:24.632271 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8e521171-a42e-48b9-82d3-3eb5d6df259d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:24.650097 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8e521171-a42e-48b9-82d3-3eb5d6df259d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:24.650465 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8e521171-a42e-48b9-82d3-3eb5d6df259d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:24.651470 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8e521171-a42e-48b9-82d3-3eb5d6df259d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:24.652046 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8e521171-a42e-48b9-82d3-3eb5d6df259d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:24.920516 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-53851b26-cd9c-4119-bf77-70366898f7f0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:24.940062 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-53851b26-cd9c-4119-bf77-70366898f7f0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.647194 Nov 19 03:20:24.940673 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 30/62] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:24 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:24.956330 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-04eee07f-83b8-436e-ba12-e2d9378e1872 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:24.957238 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-04eee07f-83b8-436e-ba12-e2d9378e1872 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:24.985846 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04eee07f-83b8-436e-ba12-e2d9378e1872 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:24.994169 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04eee07f-83b8-436e-ba12-e2d9378e1872 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:24.995211 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04eee07f-83b8-436e-ba12-e2d9378e1872 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:24.995804 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04eee07f-83b8-436e-ba12-e2d9378e1872 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:25.193408 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-04eee07f-83b8-436e-ba12-e2d9378e1872 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:25.199917 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8e521171-a42e-48b9-82d3-3eb5d6df259d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:25.203798 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-04eee07f-83b8-436e-ba12-e2d9378e1872 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:25.206186 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-04eee07f-83b8-436e-ba12-e2d9378e1872 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:25.208007 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8e521171-a42e-48b9-82d3-3eb5d6df259d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.584701 Nov 19 03:20:25.215998 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 33/63] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:24 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:25.216122 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-04eee07f-83b8-436e-ba12-e2d9378e1872 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1338 microversion: 2.20 time: 0.273325 Nov 19 03:20:25.222002 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-7ff193f3-efff-4fef-9461-b75b4c0ff269 req-837fa25f-4be0-4c2c-8338-cc853b1dca75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8", "tag": "0fcea7e8-8abe-4c82-990b-b3b5386e6d48"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:20:25.223368 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 31/64] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:24 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1338 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:25.228989 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:20:25.228989 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:20:25.240719 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-7ff193f3-efff-4fef-9461-b75b4c0ff269 req-837fa25f-4be0-4c2c-8338-cc853b1dca75 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:25.242565 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-7ff193f3-efff-4fef-9461-b75b4c0ff269 req-837fa25f-4be0-4c2c-8338-cc853b1dca75 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:25.261195 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2fbfa5e2-c552-464e-99ee-8bbfafbbddfa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:25.262007 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2fbfa5e2-c552-464e-99ee-8bbfafbbddfa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:25.274352 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-7ff193f3-efff-4fef-9461-b75b4c0ff269 req-837fa25f-4be0-4c2c-8338-cc853b1dca75 service nova] Creating event network-changed:0fcea7e8-8abe-4c82-990b-b3b5386e6d48 for instance 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 on hv-cinder-81803 Nov 19 03:20:25.275982 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2fbfa5e2-c552-464e-99ee-8bbfafbbddfa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:25.279026 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2fbfa5e2-c552-464e-99ee-8bbfafbbddfa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:25.280719 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-7ff193f3-efff-4fef-9461-b75b4c0ff269 req-837fa25f-4be0-4c2c-8338-cc853b1dca75 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063285 Nov 19 03:20:25.281549 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 34/65] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:20:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:20:25.284691 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2fbfa5e2-c552-464e-99ee-8bbfafbbddfa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:25.285242 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2fbfa5e2-c552-464e-99ee-8bbfafbbddfa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:25.854188 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2fbfa5e2-c552-464e-99ee-8bbfafbbddfa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:25.863129 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2fbfa5e2-c552-464e-99ee-8bbfafbbddfa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.605683 Nov 19 03:20:25.866857 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 32/66] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:25 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:25.958582 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e58a5435-b284-4a41-bc76-41edef1d4c4c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:25.959371 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e58a5435-b284-4a41-bc76-41edef1d4c4c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:25.965892 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e58a5435-b284-4a41-bc76-41edef1d4c4c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:25.971221 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e58a5435-b284-4a41-bc76-41edef1d4c4c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:25.972275 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e58a5435-b284-4a41-bc76-41edef1d4c4c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:25.973841 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e58a5435-b284-4a41-bc76-41edef1d4c4c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:26.232789 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c6385b50-2caf-4664-ae1e-f7e65b552904 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:26.233564 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c6385b50-2caf-4664-ae1e-f7e65b552904 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:26.247735 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c6385b50-2caf-4664-ae1e-f7e65b552904 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:26.248382 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c6385b50-2caf-4664-ae1e-f7e65b552904 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:26.249157 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c6385b50-2caf-4664-ae1e-f7e65b552904 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:26.249722 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c6385b50-2caf-4664-ae1e-f7e65b552904 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:26.352199 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e58a5435-b284-4a41-bc76-41edef1d4c4c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:26.365337 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e58a5435-b284-4a41-bc76-41edef1d4c4c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.411169 Nov 19 03:20:26.366082 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 35/67] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:25 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:26.381232 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8b5f508a-6185-4f54-8a31-9d7924a82151 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:26.382193 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8b5f508a-6185-4f54-8a31-9d7924a82151 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:26.389609 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8b5f508a-6185-4f54-8a31-9d7924a82151 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:26.390823 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8b5f508a-6185-4f54-8a31-9d7924a82151 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:26.391816 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8b5f508a-6185-4f54-8a31-9d7924a82151 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:26.392400 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8b5f508a-6185-4f54-8a31-9d7924a82151 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:26.691882 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c6385b50-2caf-4664-ae1e-f7e65b552904 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:26.703174 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c6385b50-2caf-4664-ae1e-f7e65b552904 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.473295 Nov 19 03:20:26.704077 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 33/68] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:26 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:26.884734 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0fcf20d5-575c-4f94-bc1c-6a1c65d25180 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:26.885344 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0fcf20d5-575c-4f94-bc1c-6a1c65d25180 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:26.895777 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0fcf20d5-575c-4f94-bc1c-6a1c65d25180 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:26.896522 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0fcf20d5-575c-4f94-bc1c-6a1c65d25180 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:26.897976 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0fcf20d5-575c-4f94-bc1c-6a1c65d25180 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:26.899840 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0fcf20d5-575c-4f94-bc1c-6a1c65d25180 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:27.167111 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8b5f508a-6185-4f54-8a31-9d7924a82151 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:27.179478 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8b5f508a-6185-4f54-8a31-9d7924a82151 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:27.182163 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8b5f508a-6185-4f54-8a31-9d7924a82151 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:27.183846 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8b5f508a-6185-4f54-8a31-9d7924a82151 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.806442 Nov 19 03:20:27.185136 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 36/69] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:26 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:27.192014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-ea0ef316-9712-4d7c-93cb-e47ec82ec227 req-c2e27a01-5c88-4fef-a503-1b343163dfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8641ae42-77ad-4054-8073-76018892c1d8", "tag": "4b50d896-6a79-4185-a31c-1931a0b889be"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:20:27.193864 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:20:27.193864 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:20:27.204612 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-ea0ef316-9712-4d7c-93cb-e47ec82ec227 req-c2e27a01-5c88-4fef-a503-1b343163dfe6 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:27.205586 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-ea0ef316-9712-4d7c-93cb-e47ec82ec227 req-c2e27a01-5c88-4fef-a503-1b343163dfe6 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:27.235657 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-ea0ef316-9712-4d7c-93cb-e47ec82ec227 req-c2e27a01-5c88-4fef-a503-1b343163dfe6 service nova] Creating event network-changed:4b50d896-6a79-4185-a31c-1931a0b889be for instance 8641ae42-77ad-4054-8073-76018892c1d8 on hv-cinder-81803 Nov 19 03:20:27.241012 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-ea0ef316-9712-4d7c-93cb-e47ec82ec227 req-c2e27a01-5c88-4fef-a503-1b343163dfe6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054328 Nov 19 03:20:27.242203 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 37/70] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:20:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:20:27.362189 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0fcf20d5-575c-4f94-bc1c-6a1c65d25180 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:27.375818 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0fcf20d5-575c-4f94-bc1c-6a1c65d25180 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.491465 Nov 19 03:20:27.375818 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 34/71] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:26 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:27.395031 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-dd25cadd-fd4a-49ff-a620-05755179d528 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:27.395768 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-dd25cadd-fd4a-49ff-a620-05755179d528 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:27.413826 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd25cadd-fd4a-49ff-a620-05755179d528 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:27.414408 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd25cadd-fd4a-49ff-a620-05755179d528 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:27.415453 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd25cadd-fd4a-49ff-a620-05755179d528 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:27.416168 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd25cadd-fd4a-49ff-a620-05755179d528 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:27.636739 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-dd25cadd-fd4a-49ff-a620-05755179d528 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:27.650022 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-dd25cadd-fd4a-49ff-a620-05755179d528 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.265686 Nov 19 03:20:27.650633 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 38/72] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:27 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:27.719176 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9ac86b0c-428a-47bf-812f-9994dfe83a67 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:27.719786 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9ac86b0c-428a-47bf-812f-9994dfe83a67 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:27.725512 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9ac86b0c-428a-47bf-812f-9994dfe83a67 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:27.726312 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9ac86b0c-428a-47bf-812f-9994dfe83a67 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:27.727276 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9ac86b0c-428a-47bf-812f-9994dfe83a67 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:27.727910 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9ac86b0c-428a-47bf-812f-9994dfe83a67 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:27.956322 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-9ac86b0c-428a-47bf-812f-9994dfe83a67 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:27.964196 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9ac86b0c-428a-47bf-812f-9994dfe83a67 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.248513 Nov 19 03:20:27.964776 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 35/73] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:27 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:28.203198 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-de176ffb-c7a0-49d8-a7a4-4f2ccc6aba6f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:28.203873 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-de176ffb-c7a0-49d8-a7a4-4f2ccc6aba6f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:28.209901 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-de176ffb-c7a0-49d8-a7a4-4f2ccc6aba6f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:28.210432 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-de176ffb-c7a0-49d8-a7a4-4f2ccc6aba6f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:28.211397 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-de176ffb-c7a0-49d8-a7a4-4f2ccc6aba6f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:28.212030 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-de176ffb-c7a0-49d8-a7a4-4f2ccc6aba6f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:28.378364 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-de176ffb-c7a0-49d8-a7a4-4f2ccc6aba6f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:28.388928 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-57169f51-2de8-4e95-8dfc-0e921c9fb237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:28.389635 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-57169f51-2de8-4e95-8dfc-0e921c9fb237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:28.389934 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-de176ffb-c7a0-49d8-a7a4-4f2ccc6aba6f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:28.392430 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-de176ffb-c7a0-49d8-a7a4-4f2ccc6aba6f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:28.393801 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-de176ffb-c7a0-49d8-a7a4-4f2ccc6aba6f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.195104 Nov 19 03:20:28.397346 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-57169f51-2de8-4e95-8dfc-0e921c9fb237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:28.398015 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-57169f51-2de8-4e95-8dfc-0e921c9fb237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:28.399399 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-57169f51-2de8-4e95-8dfc-0e921c9fb237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:28.400196 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-57169f51-2de8-4e95-8dfc-0e921c9fb237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:28.404814 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 39/74] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:28 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:28.544996 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-57169f51-2de8-4e95-8dfc-0e921c9fb237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:28.556472 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-57169f51-2de8-4e95-8dfc-0e921c9fb237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.171531 Nov 19 03:20:28.557149 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 36/75] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:28 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:28.667133 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7d0c3cc2-99cc-4298-a853-82a5e4a29f34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:28.667745 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7d0c3cc2-99cc-4298-a853-82a5e4a29f34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:28.673903 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7d0c3cc2-99cc-4298-a853-82a5e4a29f34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:28.674357 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7d0c3cc2-99cc-4298-a853-82a5e4a29f34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:28.675165 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7d0c3cc2-99cc-4298-a853-82a5e4a29f34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:28.675603 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7d0c3cc2-99cc-4298-a853-82a5e4a29f34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:28.832795 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7d0c3cc2-99cc-4298-a853-82a5e4a29f34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:28.841081 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7d0c3cc2-99cc-4298-a853-82a5e4a29f34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.177221 Nov 19 03:20:28.841952 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 40/76] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:28 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:28.980909 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ab9b1da7-93a5-4721-8b0e-ff975b4a95f5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:28.981764 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ab9b1da7-93a5-4721-8b0e-ff975b4a95f5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:28.989616 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab9b1da7-93a5-4721-8b0e-ff975b4a95f5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:28.990053 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab9b1da7-93a5-4721-8b0e-ff975b4a95f5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:28.990856 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab9b1da7-93a5-4721-8b0e-ff975b4a95f5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:28.991279 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab9b1da7-93a5-4721-8b0e-ff975b4a95f5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:29.135292 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ab9b1da7-93a5-4721-8b0e-ff975b4a95f5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:29.143323 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ab9b1da7-93a5-4721-8b0e-ff975b4a95f5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.166060 Nov 19 03:20:29.143881 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 37/77] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:28 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:29.412257 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ceb2314d-86e0-4c80-a8cb-a64b725164c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:29.413027 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ceb2314d-86e0-4c80-a8cb-a64b725164c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:29.418793 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ceb2314d-86e0-4c80-a8cb-a64b725164c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:29.419240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ceb2314d-86e0-4c80-a8cb-a64b725164c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:29.420013 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ceb2314d-86e0-4c80-a8cb-a64b725164c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:29.420447 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ceb2314d-86e0-4c80-a8cb-a64b725164c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:29.551742 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ceb2314d-86e0-4c80-a8cb-a64b725164c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:29.560197 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ceb2314d-86e0-4c80-a8cb-a64b725164c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:29.561692 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ceb2314d-86e0-4c80-a8cb-a64b725164c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:29.562832 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ceb2314d-86e0-4c80-a8cb-a64b725164c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.154395 Nov 19 03:20:29.563643 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 41/78] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:29 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:29.580361 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a657ed15-b96e-4586-8044-49183b8f6895 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:29.581204 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a657ed15-b96e-4586-8044-49183b8f6895 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:29.587095 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a657ed15-b96e-4586-8044-49183b8f6895 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:29.587538 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a657ed15-b96e-4586-8044-49183b8f6895 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:29.588306 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a657ed15-b96e-4586-8044-49183b8f6895 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:29.588735 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a657ed15-b96e-4586-8044-49183b8f6895 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:29.725505 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a657ed15-b96e-4586-8044-49183b8f6895 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:29.732853 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a657ed15-b96e-4586-8044-49183b8f6895 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.156739 Nov 19 03:20:29.733414 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 38/79] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:29 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:29.858038 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d94f638b-edff-4ca8-b445-885951e572c1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:29.858715 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d94f638b-edff-4ca8-b445-885951e572c1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:29.865511 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d94f638b-edff-4ca8-b445-885951e572c1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:29.866045 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d94f638b-edff-4ca8-b445-885951e572c1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:29.866925 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d94f638b-edff-4ca8-b445-885951e572c1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:29.867420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d94f638b-edff-4ca8-b445-885951e572c1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:30.002006 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d94f638b-edff-4ca8-b445-885951e572c1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:30.011350 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d94f638b-edff-4ca8-b445-885951e572c1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.156808 Nov 19 03:20:30.012596 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 42/80] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:29 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:30.160949 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f412f115-fa15-40c1-aab1-fe48cfce9042 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:30.161547 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f412f115-fa15-40c1-aab1-fe48cfce9042 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:30.167172 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f412f115-fa15-40c1-aab1-fe48cfce9042 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:30.167612 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f412f115-fa15-40c1-aab1-fe48cfce9042 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:30.168369 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f412f115-fa15-40c1-aab1-fe48cfce9042 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:30.168789 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f412f115-fa15-40c1-aab1-fe48cfce9042 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:30.309243 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-f412f115-fa15-40c1-aab1-fe48cfce9042 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:30.316632 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f412f115-fa15-40c1-aab1-fe48cfce9042 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.159511 Nov 19 03:20:30.317246 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 39/81] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:30 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:30.580572 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-84713c80-b968-4087-8b39-a5beabd74cb4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:30.581254 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-84713c80-b968-4087-8b39-a5beabd74cb4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:30.587041 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-84713c80-b968-4087-8b39-a5beabd74cb4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:30.587559 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-84713c80-b968-4087-8b39-a5beabd74cb4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:30.588417 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-84713c80-b968-4087-8b39-a5beabd74cb4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:30.588922 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-84713c80-b968-4087-8b39-a5beabd74cb4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:30.716504 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-84713c80-b968-4087-8b39-a5beabd74cb4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:30.724437 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-84713c80-b968-4087-8b39-a5beabd74cb4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:30.725852 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-84713c80-b968-4087-8b39-a5beabd74cb4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:30.726973 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-84713c80-b968-4087-8b39-a5beabd74cb4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.150714 Nov 19 03:20:30.727527 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 43/82] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:30 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:30.749269 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2470ee91-e6e6-484b-aa92-b80afd362281 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:30.750854 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2470ee91-e6e6-484b-aa92-b80afd362281 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:30.756736 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2470ee91-e6e6-484b-aa92-b80afd362281 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:30.757185 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2470ee91-e6e6-484b-aa92-b80afd362281 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:30.757950 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2470ee91-e6e6-484b-aa92-b80afd362281 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:30.758380 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2470ee91-e6e6-484b-aa92-b80afd362281 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:30.887461 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2470ee91-e6e6-484b-aa92-b80afd362281 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:30.894956 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2470ee91-e6e6-484b-aa92-b80afd362281 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.149376 Nov 19 03:20:30.895542 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 40/83] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:30 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:31.028479 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4d33349f-cbba-498c-87c8-7f8f57d1564c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:31.029084 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4d33349f-cbba-498c-87c8-7f8f57d1564c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:31.036415 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d33349f-cbba-498c-87c8-7f8f57d1564c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:31.036867 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d33349f-cbba-498c-87c8-7f8f57d1564c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:31.037649 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d33349f-cbba-498c-87c8-7f8f57d1564c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:31.038083 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d33349f-cbba-498c-87c8-7f8f57d1564c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:31.169185 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4d33349f-cbba-498c-87c8-7f8f57d1564c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:31.176530 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4d33349f-cbba-498c-87c8-7f8f57d1564c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.151637 Nov 19 03:20:31.177100 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 44/84] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:31 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:31.333836 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-74bf2f56-9800-4005-9295-43560d3623f7 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:31.334450 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-74bf2f56-9800-4005-9295-43560d3623f7 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:31.341198 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-74bf2f56-9800-4005-9295-43560d3623f7 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:31.341642 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-74bf2f56-9800-4005-9295-43560d3623f7 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:31.342428 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-74bf2f56-9800-4005-9295-43560d3623f7 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:31.342883 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-74bf2f56-9800-4005-9295-43560d3623f7 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:31.494627 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-74bf2f56-9800-4005-9295-43560d3623f7 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:31.503159 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-74bf2f56-9800-4005-9295-43560d3623f7 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.173271 Nov 19 03:20:31.503967 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 41/85] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:31 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:31.745127 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0795ee9c-e9f0-4acd-8074-591ac6cdae0d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:31.746341 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0795ee9c-e9f0-4acd-8074-591ac6cdae0d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:31.755268 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0795ee9c-e9f0-4acd-8074-591ac6cdae0d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:31.756271 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0795ee9c-e9f0-4acd-8074-591ac6cdae0d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:31.757134 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0795ee9c-e9f0-4acd-8074-591ac6cdae0d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:31.757729 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0795ee9c-e9f0-4acd-8074-591ac6cdae0d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:31.902442 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0795ee9c-e9f0-4acd-8074-591ac6cdae0d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:31.912286 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-306a7b36-fa00-461d-9d93-0dd4cc4e9976 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:31.913609 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-306a7b36-fa00-461d-9d93-0dd4cc4e9976 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:31.927615 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0795ee9c-e9f0-4acd-8074-591ac6cdae0d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:31.929415 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0795ee9c-e9f0-4acd-8074-591ac6cdae0d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:31.930593 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0795ee9c-e9f0-4acd-8074-591ac6cdae0d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.189697 Nov 19 03:20:31.941510 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 45/86] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:31 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:31.942645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-306a7b36-fa00-461d-9d93-0dd4cc4e9976 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:31.943096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-306a7b36-fa00-461d-9d93-0dd4cc4e9976 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:31.944614 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-306a7b36-fa00-461d-9d93-0dd4cc4e9976 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:31.945214 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-306a7b36-fa00-461d-9d93-0dd4cc4e9976 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:32.104813 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-306a7b36-fa00-461d-9d93-0dd4cc4e9976 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:32.118295 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-306a7b36-fa00-461d-9d93-0dd4cc4e9976 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.209621 Nov 19 03:20:32.134036 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 42/87] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:31 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:32.197982 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ffbb53f3-15d1-400a-b36e-13068216d264 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:32.198731 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ffbb53f3-15d1-400a-b36e-13068216d264 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:32.208191 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ffbb53f3-15d1-400a-b36e-13068216d264 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:32.208638 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ffbb53f3-15d1-400a-b36e-13068216d264 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:32.209448 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ffbb53f3-15d1-400a-b36e-13068216d264 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:32.209875 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ffbb53f3-15d1-400a-b36e-13068216d264 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:32.355744 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ffbb53f3-15d1-400a-b36e-13068216d264 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:32.363477 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ffbb53f3-15d1-400a-b36e-13068216d264 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.173261 Nov 19 03:20:32.364044 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 46/88] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:32 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:32.520790 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8e543a9c-f728-42d9-9cac-5920a056fbaa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:32.521440 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8e543a9c-f728-42d9-9cac-5920a056fbaa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:32.538832 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e543a9c-f728-42d9-9cac-5920a056fbaa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:32.539294 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e543a9c-f728-42d9-9cac-5920a056fbaa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:32.540143 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e543a9c-f728-42d9-9cac-5920a056fbaa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:32.540602 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e543a9c-f728-42d9-9cac-5920a056fbaa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:32.673079 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8e543a9c-f728-42d9-9cac-5920a056fbaa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:32.680400 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8e543a9c-f728-42d9-9cac-5920a056fbaa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.163374 Nov 19 03:20:32.680969 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 43/89] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:32 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:32.950073 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d1edb615-0a9f-4212-acfa-396302740036 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:32.950742 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d1edb615-0a9f-4212-acfa-396302740036 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:32.956692 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d1edb615-0a9f-4212-acfa-396302740036 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:32.957138 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d1edb615-0a9f-4212-acfa-396302740036 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:32.957910 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d1edb615-0a9f-4212-acfa-396302740036 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:32.958373 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d1edb615-0a9f-4212-acfa-396302740036 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:33.094763 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d1edb615-0a9f-4212-acfa-396302740036 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:33.102521 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d1edb615-0a9f-4212-acfa-396302740036 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:33.103975 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d1edb615-0a9f-4212-acfa-396302740036 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:33.105123 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d1edb615-0a9f-4212-acfa-396302740036 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.158764 Nov 19 03:20:33.105640 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 47/90] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:32 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:33.142519 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cba99139-a05a-4463-944a-f41835dafece tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:33.143126 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-cba99139-a05a-4463-944a-f41835dafece tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:33.149337 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cba99139-a05a-4463-944a-f41835dafece tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:33.149784 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cba99139-a05a-4463-944a-f41835dafece tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:33.150617 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cba99139-a05a-4463-944a-f41835dafece tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:33.151222 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cba99139-a05a-4463-944a-f41835dafece tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:33.281643 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-cba99139-a05a-4463-944a-f41835dafece tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:33.289350 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cba99139-a05a-4463-944a-f41835dafece tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.150436 Nov 19 03:20:33.289815 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 44/91] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:33 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:33.382844 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8f116b01-2bc5-4ad1-8ef3-a11fd0efb4be tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:33.383488 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8f116b01-2bc5-4ad1-8ef3-a11fd0efb4be tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:33.389309 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f116b01-2bc5-4ad1-8ef3-a11fd0efb4be tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:33.389846 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f116b01-2bc5-4ad1-8ef3-a11fd0efb4be tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:33.390872 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f116b01-2bc5-4ad1-8ef3-a11fd0efb4be tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:33.391306 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f116b01-2bc5-4ad1-8ef3-a11fd0efb4be tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:33.522974 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8f116b01-2bc5-4ad1-8ef3-a11fd0efb4be tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:33.530425 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8f116b01-2bc5-4ad1-8ef3-a11fd0efb4be tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.150868 Nov 19 03:20:33.531754 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 48/92] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:33 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:33.698908 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0f852dc0-a906-4133-9576-f69f0fcae7b4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:33.699511 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0f852dc0-a906-4133-9576-f69f0fcae7b4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:33.705133 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0f852dc0-a906-4133-9576-f69f0fcae7b4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:33.705574 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0f852dc0-a906-4133-9576-f69f0fcae7b4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:33.706329 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0f852dc0-a906-4133-9576-f69f0fcae7b4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:33.706781 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0f852dc0-a906-4133-9576-f69f0fcae7b4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:33.836722 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0f852dc0-a906-4133-9576-f69f0fcae7b4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:33.844568 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0f852dc0-a906-4133-9576-f69f0fcae7b4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.149140 Nov 19 03:20:33.845126 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 45/93] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:33 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:34.123232 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9fb59f41-2501-4e01-8352-51534fff4231 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:34.123832 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9fb59f41-2501-4e01-8352-51534fff4231 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:34.129715 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9fb59f41-2501-4e01-8352-51534fff4231 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:34.130160 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9fb59f41-2501-4e01-8352-51534fff4231 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:34.130954 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9fb59f41-2501-4e01-8352-51534fff4231 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:34.131386 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9fb59f41-2501-4e01-8352-51534fff4231 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:34.261290 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9fb59f41-2501-4e01-8352-51534fff4231 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:34.269680 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9fb59f41-2501-4e01-8352-51534fff4231 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:34.271193 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9fb59f41-2501-4e01-8352-51534fff4231 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:34.272533 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9fb59f41-2501-4e01-8352-51534fff4231 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.152966 Nov 19 03:20:34.273081 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 49/94] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:34 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:34.307520 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9cb6b2fc-9a94-4b07-8fb6-95f4bfe7625d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:34.308141 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9cb6b2fc-9a94-4b07-8fb6-95f4bfe7625d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:34.315862 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9cb6b2fc-9a94-4b07-8fb6-95f4bfe7625d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:34.316312 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9cb6b2fc-9a94-4b07-8fb6-95f4bfe7625d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:34.317103 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9cb6b2fc-9a94-4b07-8fb6-95f4bfe7625d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:34.317537 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9cb6b2fc-9a94-4b07-8fb6-95f4bfe7625d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:34.448706 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-9cb6b2fc-9a94-4b07-8fb6-95f4bfe7625d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:34.456734 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9cb6b2fc-9a94-4b07-8fb6-95f4bfe7625d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.154169 Nov 19 03:20:34.457299 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 46/95] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:34 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:34.548671 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3ad50365-a3bd-4103-a377-eb56a335c9fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:34.549260 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3ad50365-a3bd-4103-a377-eb56a335c9fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:34.555182 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3ad50365-a3bd-4103-a377-eb56a335c9fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:34.555627 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3ad50365-a3bd-4103-a377-eb56a335c9fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:34.556388 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3ad50365-a3bd-4103-a377-eb56a335c9fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:34.556817 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3ad50365-a3bd-4103-a377-eb56a335c9fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:34.688995 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3ad50365-a3bd-4103-a377-eb56a335c9fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:34.696813 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3ad50365-a3bd-4103-a377-eb56a335c9fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.152260 Nov 19 03:20:34.697495 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 50/96] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:34 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:34.861270 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-04cfd62e-4d7e-4319-82f4-43638f11ec74 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:34.861868 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-04cfd62e-4d7e-4319-82f4-43638f11ec74 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:34.867996 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04cfd62e-4d7e-4319-82f4-43638f11ec74 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:34.868433 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04cfd62e-4d7e-4319-82f4-43638f11ec74 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:34.869217 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04cfd62e-4d7e-4319-82f4-43638f11ec74 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:34.869642 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04cfd62e-4d7e-4319-82f4-43638f11ec74 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:34.999054 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-04cfd62e-4d7e-4319-82f4-43638f11ec74 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:35.007796 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-04cfd62e-4d7e-4319-82f4-43638f11ec74 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.150652 Nov 19 03:20:35.008677 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 47/97] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:34 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:35.289957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2234717c-1f2c-4f1f-ae7f-83746c6b0d5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:35.290576 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2234717c-1f2c-4f1f-ae7f-83746c6b0d5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:35.296835 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2234717c-1f2c-4f1f-ae7f-83746c6b0d5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:35.297372 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2234717c-1f2c-4f1f-ae7f-83746c6b0d5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:35.298153 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2234717c-1f2c-4f1f-ae7f-83746c6b0d5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:35.298607 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2234717c-1f2c-4f1f-ae7f-83746c6b0d5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:35.431240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2234717c-1f2c-4f1f-ae7f-83746c6b0d5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:35.439375 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2234717c-1f2c-4f1f-ae7f-83746c6b0d5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:35.440850 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2234717c-1f2c-4f1f-ae7f-83746c6b0d5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:35.441942 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2234717c-1f2c-4f1f-ae7f-83746c6b0d5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.155611 Nov 19 03:20:35.442511 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 51/98] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:35 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:35.473223 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ab449739-39dc-4ad4-bb48-ebd3d7d7bd4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:35.473821 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ab449739-39dc-4ad4-bb48-ebd3d7d7bd4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:35.479694 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab449739-39dc-4ad4-bb48-ebd3d7d7bd4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:35.480077 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab449739-39dc-4ad4-bb48-ebd3d7d7bd4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:35.480871 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab449739-39dc-4ad4-bb48-ebd3d7d7bd4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:35.481299 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab449739-39dc-4ad4-bb48-ebd3d7d7bd4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:35.609974 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ab449739-39dc-4ad4-bb48-ebd3d7d7bd4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:35.617327 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ab449739-39dc-4ad4-bb48-ebd3d7d7bd4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.147617 Nov 19 03:20:35.617889 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 48/99] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:35 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:35.713778 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3d651b6b-304b-4f0c-b209-cf7901c41592 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:35.714371 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3d651b6b-304b-4f0c-b209-cf7901c41592 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:35.720804 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3d651b6b-304b-4f0c-b209-cf7901c41592 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:35.721246 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3d651b6b-304b-4f0c-b209-cf7901c41592 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:35.721999 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3d651b6b-304b-4f0c-b209-cf7901c41592 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:35.722423 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3d651b6b-304b-4f0c-b209-cf7901c41592 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:35.853834 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3d651b6b-304b-4f0c-b209-cf7901c41592 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:35.861664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3d651b6b-304b-4f0c-b209-cf7901c41592 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.151379 Nov 19 03:20:35.862228 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 52/100] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:35 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:36.024894 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d7b7254a-5503-4402-a9bd-cb038bde8d56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:36.025417 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d7b7254a-5503-4402-a9bd-cb038bde8d56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:36.036319 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7b7254a-5503-4402-a9bd-cb038bde8d56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:36.037032 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7b7254a-5503-4402-a9bd-cb038bde8d56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:36.038418 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7b7254a-5503-4402-a9bd-cb038bde8d56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:36.039032 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7b7254a-5503-4402-a9bd-cb038bde8d56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:36.170406 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d7b7254a-5503-4402-a9bd-cb038bde8d56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:36.178296 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d7b7254a-5503-4402-a9bd-cb038bde8d56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.157215 Nov 19 03:20:36.178906 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 49/101] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:36 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:36.459626 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a1932e91-58c4-4bda-b1cd-39b0dfb3416e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:36.460255 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a1932e91-58c4-4bda-b1cd-39b0dfb3416e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:36.468036 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a1932e91-58c4-4bda-b1cd-39b0dfb3416e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:36.468650 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a1932e91-58c4-4bda-b1cd-39b0dfb3416e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:36.469761 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a1932e91-58c4-4bda-b1cd-39b0dfb3416e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:36.470365 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a1932e91-58c4-4bda-b1cd-39b0dfb3416e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:36.595964 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a1932e91-58c4-4bda-b1cd-39b0dfb3416e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:36.603679 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a1932e91-58c4-4bda-b1cd-39b0dfb3416e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:36.605156 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a1932e91-58c4-4bda-b1cd-39b0dfb3416e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:36.606242 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a1932e91-58c4-4bda-b1cd-39b0dfb3416e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.150299 Nov 19 03:20:36.606850 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 53/102] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:36 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:36.634449 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-069a22a0-426f-4aa4-8652-1bcce5e1a596 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:36.635081 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-069a22a0-426f-4aa4-8652-1bcce5e1a596 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:36.641567 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-069a22a0-426f-4aa4-8652-1bcce5e1a596 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:36.642008 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-069a22a0-426f-4aa4-8652-1bcce5e1a596 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:36.642800 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-069a22a0-426f-4aa4-8652-1bcce5e1a596 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:36.643226 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-069a22a0-426f-4aa4-8652-1bcce5e1a596 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:36.776262 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-069a22a0-426f-4aa4-8652-1bcce5e1a596 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:36.783715 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-069a22a0-426f-4aa4-8652-1bcce5e1a596 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.152865 Nov 19 03:20:36.784272 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 50/103] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:36 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:36.878916 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9f5fc691-de05-49ad-97ba-9354643aa677 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:36.879553 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9f5fc691-de05-49ad-97ba-9354643aa677 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:36.886518 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9f5fc691-de05-49ad-97ba-9354643aa677 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:36.886991 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9f5fc691-de05-49ad-97ba-9354643aa677 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:36.887883 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9f5fc691-de05-49ad-97ba-9354643aa677 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:36.888314 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9f5fc691-de05-49ad-97ba-9354643aa677 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:37.016151 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9f5fc691-de05-49ad-97ba-9354643aa677 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:37.023505 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9f5fc691-de05-49ad-97ba-9354643aa677 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.148923 Nov 19 03:20:37.024052 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 54/104] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:36 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:37.194889 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-34ded421-73cf-4d32-8785-96150c85dc95 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:37.195494 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-34ded421-73cf-4d32-8785-96150c85dc95 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:37.201331 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34ded421-73cf-4d32-8785-96150c85dc95 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:37.201772 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34ded421-73cf-4d32-8785-96150c85dc95 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:37.202604 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34ded421-73cf-4d32-8785-96150c85dc95 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:37.203378 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34ded421-73cf-4d32-8785-96150c85dc95 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:37.336031 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-34ded421-73cf-4d32-8785-96150c85dc95 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:37.343800 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-34ded421-73cf-4d32-8785-96150c85dc95 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.151912 Nov 19 03:20:37.344890 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 51/105] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:37 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:37.625337 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5177874c-3ba0-4889-ada2-8dca87008e58 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:37.625859 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5177874c-3ba0-4889-ada2-8dca87008e58 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:37.631755 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5177874c-3ba0-4889-ada2-8dca87008e58 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:37.632204 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5177874c-3ba0-4889-ada2-8dca87008e58 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:37.632972 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5177874c-3ba0-4889-ada2-8dca87008e58 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:37.633411 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5177874c-3ba0-4889-ada2-8dca87008e58 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:37.765575 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5177874c-3ba0-4889-ada2-8dca87008e58 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:37.773436 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5177874c-3ba0-4889-ada2-8dca87008e58 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:37.774967 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5177874c-3ba0-4889-ada2-8dca87008e58 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:37.776053 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5177874c-3ba0-4889-ada2-8dca87008e58 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.154814 Nov 19 03:20:37.776604 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 55/106] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:37 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:37.800389 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-654c8fd8-fd81-42ef-8354-1b7fb8ec7436 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:37.800999 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-654c8fd8-fd81-42ef-8354-1b7fb8ec7436 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:37.807299 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-654c8fd8-fd81-42ef-8354-1b7fb8ec7436 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:37.807754 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-654c8fd8-fd81-42ef-8354-1b7fb8ec7436 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:37.808549 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-654c8fd8-fd81-42ef-8354-1b7fb8ec7436 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:37.808978 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-654c8fd8-fd81-42ef-8354-1b7fb8ec7436 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:37.938408 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-654c8fd8-fd81-42ef-8354-1b7fb8ec7436 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:37.946281 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-654c8fd8-fd81-42ef-8354-1b7fb8ec7436 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.149269 Nov 19 03:20:37.946953 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 52/107] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:37 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:38.040190 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-24470bbf-83a3-4de2-808e-cb9f32241f33 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:38.040798 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-24470bbf-83a3-4de2-808e-cb9f32241f33 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:38.046796 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-24470bbf-83a3-4de2-808e-cb9f32241f33 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:38.047247 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-24470bbf-83a3-4de2-808e-cb9f32241f33 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:38.048016 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-24470bbf-83a3-4de2-808e-cb9f32241f33 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:38.048451 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-24470bbf-83a3-4de2-808e-cb9f32241f33 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:38.178886 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-24470bbf-83a3-4de2-808e-cb9f32241f33 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:38.186042 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-24470bbf-83a3-4de2-808e-cb9f32241f33 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.149441 Nov 19 03:20:38.186631 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 56/108] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:38 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:38.368199 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ab1ed637-4491-42a1-b133-9ad61f4f5900 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:38.368814 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ab1ed637-4491-42a1-b133-9ad61f4f5900 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:38.375091 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab1ed637-4491-42a1-b133-9ad61f4f5900 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:38.375545 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab1ed637-4491-42a1-b133-9ad61f4f5900 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:38.376334 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab1ed637-4491-42a1-b133-9ad61f4f5900 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:38.376775 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab1ed637-4491-42a1-b133-9ad61f4f5900 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:38.510107 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ab1ed637-4491-42a1-b133-9ad61f4f5900 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:38.517953 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ab1ed637-4491-42a1-b133-9ad61f4f5900 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.159900 Nov 19 03:20:38.518530 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 53/109] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:38 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:38.794334 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-44dfd24e-7ed8-4638-a2da-24c94fd9ff40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:38.794974 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-44dfd24e-7ed8-4638-a2da-24c94fd9ff40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:38.800865 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-44dfd24e-7ed8-4638-a2da-24c94fd9ff40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:38.801305 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-44dfd24e-7ed8-4638-a2da-24c94fd9ff40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:38.802099 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-44dfd24e-7ed8-4638-a2da-24c94fd9ff40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:38.802553 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-44dfd24e-7ed8-4638-a2da-24c94fd9ff40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:38.933539 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-44dfd24e-7ed8-4638-a2da-24c94fd9ff40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:38.942668 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-44dfd24e-7ed8-4638-a2da-24c94fd9ff40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:38.944132 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-44dfd24e-7ed8-4638-a2da-24c94fd9ff40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:38.945212 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-44dfd24e-7ed8-4638-a2da-24c94fd9ff40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.154624 Nov 19 03:20:38.945749 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 57/110] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:38 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:38.963498 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8916fc6d-fabb-444c-b33f-16b1335bcd8c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:38.964090 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8916fc6d-fabb-444c-b33f-16b1335bcd8c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:38.969893 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8916fc6d-fabb-444c-b33f-16b1335bcd8c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:38.970370 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8916fc6d-fabb-444c-b33f-16b1335bcd8c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:38.971190 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8916fc6d-fabb-444c-b33f-16b1335bcd8c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:38.971637 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8916fc6d-fabb-444c-b33f-16b1335bcd8c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:39.105855 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8916fc6d-fabb-444c-b33f-16b1335bcd8c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:39.114819 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8916fc6d-fabb-444c-b33f-16b1335bcd8c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.154725 Nov 19 03:20:39.115487 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 54/111] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:38 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:39.203630 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d0fda25e-1da9-406e-8a53-84e665e71aff tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:39.204235 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d0fda25e-1da9-406e-8a53-84e665e71aff tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:39.210791 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d0fda25e-1da9-406e-8a53-84e665e71aff tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:39.211223 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d0fda25e-1da9-406e-8a53-84e665e71aff tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:39.211995 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d0fda25e-1da9-406e-8a53-84e665e71aff tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:39.212430 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d0fda25e-1da9-406e-8a53-84e665e71aff tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:39.360143 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d0fda25e-1da9-406e-8a53-84e665e71aff tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:39.367767 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d0fda25e-1da9-406e-8a53-84e665e71aff tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.168072 Nov 19 03:20:39.368352 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 58/112] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:39 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:39.535432 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-626c3a6b-fb67-436b-9722-79177ae58af1 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:39.536070 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-626c3a6b-fb67-436b-9722-79177ae58af1 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:39.542046 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-626c3a6b-fb67-436b-9722-79177ae58af1 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:39.542707 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-626c3a6b-fb67-436b-9722-79177ae58af1 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:39.543752 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-626c3a6b-fb67-436b-9722-79177ae58af1 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:39.544172 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-626c3a6b-fb67-436b-9722-79177ae58af1 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:39.679605 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-626c3a6b-fb67-436b-9722-79177ae58af1 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:39.686904 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-626c3a6b-fb67-436b-9722-79177ae58af1 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.154963 Nov 19 03:20:39.687478 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 55/113] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:39 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:39.963333 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-62cd64c2-a744-4262-b64d-69b46e5ba431 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:39.964027 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-62cd64c2-a744-4262-b64d-69b46e5ba431 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:39.970644 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-62cd64c2-a744-4262-b64d-69b46e5ba431 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:39.971090 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-62cd64c2-a744-4262-b64d-69b46e5ba431 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:39.971857 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-62cd64c2-a744-4262-b64d-69b46e5ba431 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:39.972289 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-62cd64c2-a744-4262-b64d-69b46e5ba431 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:40.038274 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-594004510", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:20:40.103544 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.network.neutron [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] validate_networks() for None {{(pid=116066) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:20:40.113720 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-62cd64c2-a744-4262-b64d-69b46e5ba431 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:40.121523 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-62cd64c2-a744-4262-b64d-69b46e5ba431 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:40.123060 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-62cd64c2-a744-4262-b64d-69b46e5ba431 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:40.124151 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-62cd64c2-a744-4262-b64d-69b46e5ba431 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.164448 Nov 19 03:20:40.124878 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 59/114] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:39 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:40.137249 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-fc4d9640-2a72-42c4-ac40-6058287cd0e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:40.137871 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-fc4d9640-2a72-42c4-ac40-6058287cd0e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:40.150178 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fc4d9640-2a72-42c4-ac40-6058287cd0e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:40.150178 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fc4d9640-2a72-42c4-ac40-6058287cd0e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:40.150178 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fc4d9640-2a72-42c4-ac40-6058287cd0e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:40.150178 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fc4d9640-2a72-42c4-ac40-6058287cd0e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:40.623872 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-fc4d9640-2a72-42c4-ac40-6058287cd0e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:40.632012 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-fc4d9640-2a72-42c4-ac40-6058287cd0e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.498160 Nov 19 03:20:40.632698 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 60/115] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:40 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:40.637007 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-fe1df1a7-18f0-4982-bafe-ec5df135b8bb tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:40.637735 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-fe1df1a7-18f0-4982-bafe-ec5df135b8bb tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:40.643466 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fe1df1a7-18f0-4982-bafe-ec5df135b8bb tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:40.643916 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fe1df1a7-18f0-4982-bafe-ec5df135b8bb tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:40.644692 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fe1df1a7-18f0-4982-bafe-ec5df135b8bb tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:40.645125 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fe1df1a7-18f0-4982-bafe-ec5df135b8bb tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:40.655933 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Flavor limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:20:40.656403 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Image limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:20:40.656945 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Flavor pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:20:40.657460 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Image pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:20:40.657939 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:20:40.667678 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:40.668123 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:40.668935 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:40.669372 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:40.685860 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Getting quotas for project 1bb6b42dcbee4a2e816a4831adf88bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:20:40.690400 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Getting quotas for user 2ff0cf421da24952967aff15f565db46 and project 1bb6b42dcbee4a2e816a4831adf88bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:20:40.701269 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Going to run 1 instances... {{(pid=116066) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:20:40.703924 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:20:40.746638 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e33d7205-0e72-4ba6-bb46-3ad82241d0c2 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711808 Nov 19 03:20:40.752217 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 56/116] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:20:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 03:20:40.752217 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2db71d10-ae8b-4386-9601-5d9b3f5979cc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:40.752454 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2db71d10-ae8b-4386-9601-5d9b3f5979cc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:40.758658 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2db71d10-ae8b-4386-9601-5d9b3f5979cc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:40.759030 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2db71d10-ae8b-4386-9601-5d9b3f5979cc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:40.759813 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2db71d10-ae8b-4386-9601-5d9b3f5979cc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:40.760247 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2db71d10-ae8b-4386-9601-5d9b3f5979cc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:40.794507 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-fe1df1a7-18f0-4982-bafe-ec5df135b8bb tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:40.802931 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-fe1df1a7-18f0-4982-bafe-ec5df135b8bb tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.169220 Nov 19 03:20:40.803504 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 61/117] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:40 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:40.817179 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-85972fc1-5548-407c-9ef1-cdb3cf092107 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:40.817974 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-85972fc1-5548-407c-9ef1-cdb3cf092107 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:40.877966 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-85972fc1-5548-407c-9ef1-cdb3cf092107 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:40.885049 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-85972fc1-5548-407c-9ef1-cdb3cf092107 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1214 microversion: 2.1 time: 0.071266 Nov 19 03:20:40.885781 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 62/118] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:40 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:40.949340 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2db71d10-ae8b-4386-9601-5d9b3f5979cc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:40.958331 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2db71d10-ae8b-4386-9601-5d9b3f5979cc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.210041 Nov 19 03:20:40.958938 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 57/119] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:40 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:41.141931 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-234ae39b-4fad-4a44-9c92-8d7bb63e8b90 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:41.142556 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-234ae39b-4fad-4a44-9c92-8d7bb63e8b90 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:41.149186 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-234ae39b-4fad-4a44-9c92-8d7bb63e8b90 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:41.149874 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-234ae39b-4fad-4a44-9c92-8d7bb63e8b90 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:41.150892 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-234ae39b-4fad-4a44-9c92-8d7bb63e8b90 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:41.151491 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-234ae39b-4fad-4a44-9c92-8d7bb63e8b90 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:41.292599 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-234ae39b-4fad-4a44-9c92-8d7bb63e8b90 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:41.301074 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-234ae39b-4fad-4a44-9c92-8d7bb63e8b90 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:41.302587 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-234ae39b-4fad-4a44-9c92-8d7bb63e8b90 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:41.303687 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-234ae39b-4fad-4a44-9c92-8d7bb63e8b90 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.166274 Nov 19 03:20:41.304302 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 63/120] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:41 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:20:41.648659 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-60fdea9a-92e5-457d-a1c4-453474eec87d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:41.649264 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-60fdea9a-92e5-457d-a1c4-453474eec87d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:41.659553 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-60fdea9a-92e5-457d-a1c4-453474eec87d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:41.660314 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-60fdea9a-92e5-457d-a1c4-453474eec87d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:41.661616 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-60fdea9a-92e5-457d-a1c4-453474eec87d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:41.662142 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-60fdea9a-92e5-457d-a1c4-453474eec87d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:41.809284 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-60fdea9a-92e5-457d-a1c4-453474eec87d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:41.818960 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-60fdea9a-92e5-457d-a1c4-453474eec87d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.174067 Nov 19 03:20:41.819929 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 58/121] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:41 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:41.820047 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-fceaa2ed-fbd8-4620-ad0c-464ce17d7e59 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:41.820697 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-fceaa2ed-fbd8-4620-ad0c-464ce17d7e59 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:41.827294 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fceaa2ed-fbd8-4620-ad0c-464ce17d7e59 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:41.828378 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fceaa2ed-fbd8-4620-ad0c-464ce17d7e59 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:41.829322 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fceaa2ed-fbd8-4620-ad0c-464ce17d7e59 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:41.829822 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fceaa2ed-fbd8-4620-ad0c-464ce17d7e59 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:41.903030 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1cbaddf9-2236-41af-9e53-fbe8f074806e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:41.903630 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1cbaddf9-2236-41af-9e53-fbe8f074806e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:41.909457 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1cbaddf9-2236-41af-9e53-fbe8f074806e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:41.909996 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1cbaddf9-2236-41af-9e53-fbe8f074806e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:41.910789 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1cbaddf9-2236-41af-9e53-fbe8f074806e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:41.911211 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1cbaddf9-2236-41af-9e53-fbe8f074806e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:41.978945 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1cbaddf9-2236-41af-9e53-fbe8f074806e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:41.986731 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1cbaddf9-2236-41af-9e53-fbe8f074806e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1218 microversion: 2.1 time: 0.087639 Nov 19 03:20:41.987317 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 59/122] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:41 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:41.991790 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e30734a7-3f59-4120-9ff8-447d2422b8a9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:41.992437 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e30734a7-3f59-4120-9ff8-447d2422b8a9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:41.998006 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e30734a7-3f59-4120-9ff8-447d2422b8a9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:41.998451 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e30734a7-3f59-4120-9ff8-447d2422b8a9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:41.999740 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e30734a7-3f59-4120-9ff8-447d2422b8a9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:42.000329 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e30734a7-3f59-4120-9ff8-447d2422b8a9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:42.003470 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-fceaa2ed-fbd8-4620-ad0c-464ce17d7e59 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:42.011606 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-fceaa2ed-fbd8-4620-ad0c-464ce17d7e59 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.195415 Nov 19 03:20:42.012177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 64/123] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:41 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:42.143174 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e30734a7-3f59-4120-9ff8-447d2422b8a9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:42.150729 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e30734a7-3f59-4120-9ff8-447d2422b8a9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.162410 Nov 19 03:20:42.151297 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 60/124] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:41 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:42.323497 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-87e33e26-5db2-4151-a6a1-d829a41e9317 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:42.324094 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-87e33e26-5db2-4151-a6a1-d829a41e9317 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:42.330505 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-87e33e26-5db2-4151-a6a1-d829a41e9317 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:42.330906 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-87e33e26-5db2-4151-a6a1-d829a41e9317 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:42.331715 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-87e33e26-5db2-4151-a6a1-d829a41e9317 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:42.332175 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-87e33e26-5db2-4151-a6a1-d829a41e9317 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:42.463187 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-87e33e26-5db2-4151-a6a1-d829a41e9317 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:42.472366 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-87e33e26-5db2-4151-a6a1-d829a41e9317 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:42.473848 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-87e33e26-5db2-4151-a6a1-d829a41e9317 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:42.474992 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-87e33e26-5db2-4151-a6a1-d829a41e9317 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.155194 Nov 19 03:20:42.475670 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 65/125] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:42 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:42.835946 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-64b54bcb-5e2a-4339-a94d-b25400426f71 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:42.836462 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-64b54bcb-5e2a-4339-a94d-b25400426f71 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:42.842557 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-64b54bcb-5e2a-4339-a94d-b25400426f71 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:42.843652 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-64b54bcb-5e2a-4339-a94d-b25400426f71 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:42.844548 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-64b54bcb-5e2a-4339-a94d-b25400426f71 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:42.844976 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-64b54bcb-5e2a-4339-a94d-b25400426f71 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:42.972134 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-64b54bcb-5e2a-4339-a94d-b25400426f71 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:42.979287 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-64b54bcb-5e2a-4339-a94d-b25400426f71 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.147262 Nov 19 03:20:42.979877 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 61/126] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:42 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:43.003237 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-dfceb176-89f9-4931-8b96-aca93881e063 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:43.003837 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-dfceb176-89f9-4931-8b96-aca93881e063 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:43.009669 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dfceb176-89f9-4931-8b96-aca93881e063 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:43.010126 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dfceb176-89f9-4931-8b96-aca93881e063 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:43.010902 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dfceb176-89f9-4931-8b96-aca93881e063 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:43.011333 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dfceb176-89f9-4931-8b96-aca93881e063 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:43.029017 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-fb1f0ec0-dcd2-451b-925a-d85bcf5946e6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:43.029641 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-fb1f0ec0-dcd2-451b-925a-d85bcf5946e6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:43.036522 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fb1f0ec0-dcd2-451b-925a-d85bcf5946e6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:43.036998 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fb1f0ec0-dcd2-451b-925a-d85bcf5946e6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:43.037809 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fb1f0ec0-dcd2-451b-925a-d85bcf5946e6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:43.038240 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fb1f0ec0-dcd2-451b-925a-d85bcf5946e6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:43.074071 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-dfceb176-89f9-4931-8b96-aca93881e063 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:43.082543 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-dfceb176-89f9-4931-8b96-aca93881e063 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1218 microversion: 2.1 time: 0.082784 Nov 19 03:20:43.083129 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 66/127] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:42 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:43.167361 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5cdee525-9de0-4587-9787-8e47ffb1941e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:43.167752 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5cdee525-9de0-4587-9787-8e47ffb1941e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:43.169691 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-fb1f0ec0-dcd2-451b-925a-d85bcf5946e6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:43.173662 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5cdee525-9de0-4587-9787-8e47ffb1941e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:43.174105 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5cdee525-9de0-4587-9787-8e47ffb1941e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:43.174907 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5cdee525-9de0-4587-9787-8e47ffb1941e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:43.175342 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5cdee525-9de0-4587-9787-8e47ffb1941e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:43.176989 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-fb1f0ec0-dcd2-451b-925a-d85bcf5946e6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.151546 Nov 19 03:20:43.177609 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 62/128] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:43 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:43.308821 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5cdee525-9de0-4587-9787-8e47ffb1941e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:43.316517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5cdee525-9de0-4587-9787-8e47ffb1941e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.152939 Nov 19 03:20:43.317074 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 67/129] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:43 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:43.492976 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c099cab7-99ea-4bb5-9316-cb8041de3c29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:43.493575 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c099cab7-99ea-4bb5-9316-cb8041de3c29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:43.499511 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c099cab7-99ea-4bb5-9316-cb8041de3c29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:43.500101 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c099cab7-99ea-4bb5-9316-cb8041de3c29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:43.500868 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c099cab7-99ea-4bb5-9316-cb8041de3c29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:43.501300 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c099cab7-99ea-4bb5-9316-cb8041de3c29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:43.643543 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c099cab7-99ea-4bb5-9316-cb8041de3c29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:43.651670 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c099cab7-99ea-4bb5-9316-cb8041de3c29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:43.653138 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c099cab7-99ea-4bb5-9316-cb8041de3c29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:43.654236 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c099cab7-99ea-4bb5-9316-cb8041de3c29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.165059 Nov 19 03:20:43.654814 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 63/130] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:43 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:43.995720 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8f602519-f6f0-4aea-addc-db3f68647492 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:43.996318 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8f602519-f6f0-4aea-addc-db3f68647492 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:44.002878 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f602519-f6f0-4aea-addc-db3f68647492 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:44.003288 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f602519-f6f0-4aea-addc-db3f68647492 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:44.004052 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f602519-f6f0-4aea-addc-db3f68647492 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:44.004481 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f602519-f6f0-4aea-addc-db3f68647492 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:44.098951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a04ea3d7-f700-4216-859b-7c29d95c3e88 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:44.099561 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a04ea3d7-f700-4216-859b-7c29d95c3e88 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:44.105282 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a04ea3d7-f700-4216-859b-7c29d95c3e88 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:44.105726 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a04ea3d7-f700-4216-859b-7c29d95c3e88 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:44.106521 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a04ea3d7-f700-4216-859b-7c29d95c3e88 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:44.106952 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a04ea3d7-f700-4216-859b-7c29d95c3e88 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:44.136616 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8f602519-f6f0-4aea-addc-db3f68647492 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:44.144823 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8f602519-f6f0-4aea-addc-db3f68647492 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.152702 Nov 19 03:20:44.145398 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 68/131] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:43 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:44.164560 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a04ea3d7-f700-4216-859b-7c29d95c3e88 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:44.171933 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a04ea3d7-f700-4216-859b-7c29d95c3e88 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1218 microversion: 2.1 time: 0.076269 Nov 19 03:20:44.172503 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 64/132] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:44 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:44.193168 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-99b2f991-a2ba-4330-945c-1a022c5db24e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:44.193765 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-99b2f991-a2ba-4330-945c-1a022c5db24e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:44.199545 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-99b2f991-a2ba-4330-945c-1a022c5db24e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:44.199989 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-99b2f991-a2ba-4330-945c-1a022c5db24e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:44.200749 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-99b2f991-a2ba-4330-945c-1a022c5db24e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:44.201177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-99b2f991-a2ba-4330-945c-1a022c5db24e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:44.331971 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-99b2f991-a2ba-4330-945c-1a022c5db24e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:44.332789 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b5706959-7863-4e54-9b1f-8d9561125387 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:44.333386 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b5706959-7863-4e54-9b1f-8d9561125387 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:44.339234 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b5706959-7863-4e54-9b1f-8d9561125387 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:44.339380 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-99b2f991-a2ba-4330-945c-1a022c5db24e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.149715 Nov 19 03:20:44.339684 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b5706959-7863-4e54-9b1f-8d9561125387 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:44.339922 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 69/133] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:44 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:44.340458 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b5706959-7863-4e54-9b1f-8d9561125387 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:44.340957 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b5706959-7863-4e54-9b1f-8d9561125387 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:44.483444 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b5706959-7863-4e54-9b1f-8d9561125387 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:44.491081 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b5706959-7863-4e54-9b1f-8d9561125387 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.161843 Nov 19 03:20:44.491635 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 65/134] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:44 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:44.674344 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1b2ee8d3-e0fa-4f4e-9434-095f5a1e9899 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:44.675236 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1b2ee8d3-e0fa-4f4e-9434-095f5a1e9899 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:44.681726 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1b2ee8d3-e0fa-4f4e-9434-095f5a1e9899 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:44.682260 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1b2ee8d3-e0fa-4f4e-9434-095f5a1e9899 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:44.683169 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1b2ee8d3-e0fa-4f4e-9434-095f5a1e9899 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:44.683665 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1b2ee8d3-e0fa-4f4e-9434-095f5a1e9899 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:44.822351 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1b2ee8d3-e0fa-4f4e-9434-095f5a1e9899 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:44.830847 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1b2ee8d3-e0fa-4f4e-9434-095f5a1e9899 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:44.832330 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1b2ee8d3-e0fa-4f4e-9434-095f5a1e9899 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:44.833417 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1b2ee8d3-e0fa-4f4e-9434-095f5a1e9899 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.164368 Nov 19 03:20:44.833971 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 70/135] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:44 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:45.160865 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-eb4746e4-5f9c-46fd-916d-6341ed1a4400 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:45.161466 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-eb4746e4-5f9c-46fd-916d-6341ed1a4400 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:45.167179 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eb4746e4-5f9c-46fd-916d-6341ed1a4400 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:45.167624 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eb4746e4-5f9c-46fd-916d-6341ed1a4400 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:45.168386 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eb4746e4-5f9c-46fd-916d-6341ed1a4400 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:45.168814 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eb4746e4-5f9c-46fd-916d-6341ed1a4400 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:45.188420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-88d5878f-dfc4-431c-90a0-e8afa28d3566 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:45.189018 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-88d5878f-dfc4-431c-90a0-e8afa28d3566 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:45.194687 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-88d5878f-dfc4-431c-90a0-e8afa28d3566 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:45.195126 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-88d5878f-dfc4-431c-90a0-e8afa28d3566 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:45.195880 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-88d5878f-dfc4-431c-90a0-e8afa28d3566 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:45.196312 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-88d5878f-dfc4-431c-90a0-e8afa28d3566 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:45.257962 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-88d5878f-dfc4-431c-90a0-e8afa28d3566 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:45.266454 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-88d5878f-dfc4-431c-90a0-e8afa28d3566 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1210 microversion: 2.1 time: 0.081441 Nov 19 03:20:45.267414 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 71/136] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:45 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:45.327042 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-eb4746e4-5f9c-46fd-916d-6341ed1a4400 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:45.334750 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-eb4746e4-5f9c-46fd-916d-6341ed1a4400 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.177387 Nov 19 03:20:45.335303 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 66/137] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:45 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:45.355602 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-eeff8ee7-16c4-4b9f-b86a-c4ff40f95e1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:45.356200 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-eeff8ee7-16c4-4b9f-b86a-c4ff40f95e1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:45.362154 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eeff8ee7-16c4-4b9f-b86a-c4ff40f95e1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:45.362635 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eeff8ee7-16c4-4b9f-b86a-c4ff40f95e1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:45.363396 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eeff8ee7-16c4-4b9f-b86a-c4ff40f95e1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:45.363826 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eeff8ee7-16c4-4b9f-b86a-c4ff40f95e1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:45.498438 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-eeff8ee7-16c4-4b9f-b86a-c4ff40f95e1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:45.506362 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-eeff8ee7-16c4-4b9f-b86a-c4ff40f95e1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.154250 Nov 19 03:20:45.506946 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 72/138] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:45 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:45.508154 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3a6ef7ce-01cd-40b8-a855-3f29631b2360 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:45.508788 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3a6ef7ce-01cd-40b8-a855-3f29631b2360 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:45.514777 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3a6ef7ce-01cd-40b8-a855-3f29631b2360 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:45.515455 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3a6ef7ce-01cd-40b8-a855-3f29631b2360 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:45.516354 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3a6ef7ce-01cd-40b8-a855-3f29631b2360 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:45.516786 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3a6ef7ce-01cd-40b8-a855-3f29631b2360 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:45.644062 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-3a6ef7ce-01cd-40b8-a855-3f29631b2360 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:45.652532 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3a6ef7ce-01cd-40b8-a855-3f29631b2360 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.147645 Nov 19 03:20:45.653273 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 67/139] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:45 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:45.851665 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e25f092a-b5d9-4ac4-b274-852cc2b00055 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:45.852183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e25f092a-b5d9-4ac4-b274-852cc2b00055 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:45.857976 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e25f092a-b5d9-4ac4-b274-852cc2b00055 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:45.858420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e25f092a-b5d9-4ac4-b274-852cc2b00055 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:45.859471 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e25f092a-b5d9-4ac4-b274-852cc2b00055 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:45.859903 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e25f092a-b5d9-4ac4-b274-852cc2b00055 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:45.996910 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e25f092a-b5d9-4ac4-b274-852cc2b00055 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:46.005065 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e25f092a-b5d9-4ac4-b274-852cc2b00055 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:46.006534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e25f092a-b5d9-4ac4-b274-852cc2b00055 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:46.007607 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e25f092a-b5d9-4ac4-b274-852cc2b00055 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.159719 Nov 19 03:20:46.008156 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 73/140] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:45 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:46.283618 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2f7f747b-0c66-4840-867b-febbcd9c183c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:46.284487 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2f7f747b-0c66-4840-867b-febbcd9c183c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:46.291175 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2f7f747b-0c66-4840-867b-febbcd9c183c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:46.291625 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2f7f747b-0c66-4840-867b-febbcd9c183c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:46.292420 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2f7f747b-0c66-4840-867b-febbcd9c183c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:46.292826 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2f7f747b-0c66-4840-867b-febbcd9c183c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:46.352337 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a08c49c7-5642-4fdf-aae4-91f24cc23c9e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:46.354855 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a08c49c7-5642-4fdf-aae4-91f24cc23c9e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:46.355777 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2f7f747b-0c66-4840-867b-febbcd9c183c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:46.361707 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a08c49c7-5642-4fdf-aae4-91f24cc23c9e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:46.362237 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a08c49c7-5642-4fdf-aae4-91f24cc23c9e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:46.363112 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a08c49c7-5642-4fdf-aae4-91f24cc23c9e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:46.364076 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a08c49c7-5642-4fdf-aae4-91f24cc23c9e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:46.364347 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2f7f747b-0c66-4840-867b-febbcd9c183c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1274 microversion: 2.1 time: 0.084418 Nov 19 03:20:46.365267 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 68/141] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:46 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:46.523163 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d1f539a8-c619-4209-8bef-3f62d9b8fa1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:46.524179 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d1f539a8-c619-4209-8bef-3f62d9b8fa1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:46.532153 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d1f539a8-c619-4209-8bef-3f62d9b8fa1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:46.532589 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d1f539a8-c619-4209-8bef-3f62d9b8fa1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:46.533376 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a08c49c7-5642-4fdf-aae4-91f24cc23c9e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:46.533712 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d1f539a8-c619-4209-8bef-3f62d9b8fa1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:46.534307 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d1f539a8-c619-4209-8bef-3f62d9b8fa1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:46.541085 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a08c49c7-5642-4fdf-aae4-91f24cc23c9e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.192686 Nov 19 03:20:46.541735 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 74/142] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:46 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:46.670791 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b0f81d61-4af8-4e9f-9606-f39a0db8c5dc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:46.671808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b0f81d61-4af8-4e9f-9606-f39a0db8c5dc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:46.675222 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d1f539a8-c619-4209-8bef-3f62d9b8fa1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:46.679715 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b0f81d61-4af8-4e9f-9606-f39a0db8c5dc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:46.680228 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b0f81d61-4af8-4e9f-9606-f39a0db8c5dc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:46.681085 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b0f81d61-4af8-4e9f-9606-f39a0db8c5dc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:46.681513 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b0f81d61-4af8-4e9f-9606-f39a0db8c5dc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:46.685321 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d1f539a8-c619-4209-8bef-3f62d9b8fa1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.165927 Nov 19 03:20:46.694574 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 69/143] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:46 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:46.860443 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b0f81d61-4af8-4e9f-9606-f39a0db8c5dc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:46.869261 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b0f81d61-4af8-4e9f-9606-f39a0db8c5dc tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.202629 Nov 19 03:20:46.878529 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 75/144] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:46 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:47.025408 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0c9ee3e5-3c74-487b-8b51-79f99848d105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:47.026006 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0c9ee3e5-3c74-487b-8b51-79f99848d105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:47.037858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0c9ee3e5-3c74-487b-8b51-79f99848d105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:47.038230 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0c9ee3e5-3c74-487b-8b51-79f99848d105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:47.039054 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0c9ee3e5-3c74-487b-8b51-79f99848d105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:47.039484 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0c9ee3e5-3c74-487b-8b51-79f99848d105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:47.236469 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0c9ee3e5-3c74-487b-8b51-79f99848d105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:47.245412 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0c9ee3e5-3c74-487b-8b51-79f99848d105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:47.247109 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0c9ee3e5-3c74-487b-8b51-79f99848d105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:47.248324 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0c9ee3e5-3c74-487b-8b51-79f99848d105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.227248 Nov 19 03:20:47.251029 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 70/145] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:47 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:47.381879 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9b393771-f0d2-4b69-90dc-54a2156f5502 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:47.383556 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9b393771-f0d2-4b69-90dc-54a2156f5502 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:47.392258 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9b393771-f0d2-4b69-90dc-54a2156f5502 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:47.396860 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9b393771-f0d2-4b69-90dc-54a2156f5502 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:47.398104 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9b393771-f0d2-4b69-90dc-54a2156f5502 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:47.398721 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9b393771-f0d2-4b69-90dc-54a2156f5502 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:47.557123 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c5024d4a-2d5e-48d7-843e-fe7ff8f46ed5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:47.557617 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c5024d4a-2d5e-48d7-843e-fe7ff8f46ed5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:47.564253 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c5024d4a-2d5e-48d7-843e-fe7ff8f46ed5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:47.564725 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c5024d4a-2d5e-48d7-843e-fe7ff8f46ed5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:47.565498 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c5024d4a-2d5e-48d7-843e-fe7ff8f46ed5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:47.565922 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c5024d4a-2d5e-48d7-843e-fe7ff8f46ed5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:47.599655 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9b393771-f0d2-4b69-90dc-54a2156f5502 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:47.607840 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9b393771-f0d2-4b69-90dc-54a2156f5502 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.230038 Nov 19 03:20:47.608561 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 76/146] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:47 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:47.704590 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-97b05d10-dbbd-44d4-a747-ed37126b5920 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:47.705497 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-97b05d10-dbbd-44d4-a747-ed37126b5920 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:47.714553 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97b05d10-dbbd-44d4-a747-ed37126b5920 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:47.715782 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97b05d10-dbbd-44d4-a747-ed37126b5920 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:47.717108 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97b05d10-dbbd-44d4-a747-ed37126b5920 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:47.718893 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97b05d10-dbbd-44d4-a747-ed37126b5920 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:47.732812 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c5024d4a-2d5e-48d7-843e-fe7ff8f46ed5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:47.741065 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c5024d4a-2d5e-48d7-843e-fe7ff8f46ed5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.187564 Nov 19 03:20:47.741713 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 71/147] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:47 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:47.883332 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-97b05d10-dbbd-44d4-a747-ed37126b5920 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:47.891128 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7aee0cf6-13b5-4c23-8ede-d9df7c6afc2d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:47.891738 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7aee0cf6-13b5-4c23-8ede-d9df7c6afc2d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:47.892077 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-97b05d10-dbbd-44d4-a747-ed37126b5920 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.192244 Nov 19 03:20:47.892779 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 77/148] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:47 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:47.898773 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7aee0cf6-13b5-4c23-8ede-d9df7c6afc2d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:47.899342 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7aee0cf6-13b5-4c23-8ede-d9df7c6afc2d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:47.900409 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7aee0cf6-13b5-4c23-8ede-d9df7c6afc2d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:47.900908 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7aee0cf6-13b5-4c23-8ede-d9df7c6afc2d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:48.063751 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-7aee0cf6-13b5-4c23-8ede-d9df7c6afc2d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:48.077873 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7aee0cf6-13b5-4c23-8ede-d9df7c6afc2d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.189385 Nov 19 03:20:48.078599 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 72/149] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:47 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:48.270065 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9a03528a-ae31-4157-98b3-48c9f806824f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:48.270538 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9a03528a-ae31-4157-98b3-48c9f806824f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:48.284135 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-d8ab1879-c931-44b6-9437-b47722dc6504 req-b20f1c17-1687-47ad-ad6e-ce4730ce6953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d668ca76-7d13-479a-81de-3fb38e242812", "tag": "314c6c6f-8af0-4b27-9cbd-6de5ea3bc3f6"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:20:48.287131 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:20:48.287131 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:20:48.290500 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a03528a-ae31-4157-98b3-48c9f806824f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:48.292918 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a03528a-ae31-4157-98b3-48c9f806824f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:48.294217 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a03528a-ae31-4157-98b3-48c9f806824f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:48.299520 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a03528a-ae31-4157-98b3-48c9f806824f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:48.323158 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-d8ab1879-c931-44b6-9437-b47722dc6504 req-b20f1c17-1687-47ad-ad6e-ce4730ce6953 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:48.325271 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-d8ab1879-c931-44b6-9437-b47722dc6504 req-b20f1c17-1687-47ad-ad6e-ce4730ce6953 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:48.353087 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-d8ab1879-c931-44b6-9437-b47722dc6504 req-b20f1c17-1687-47ad-ad6e-ce4730ce6953 service nova] Creating event network-changed:314c6c6f-8af0-4b27-9cbd-6de5ea3bc3f6 for instance d668ca76-7d13-479a-81de-3fb38e242812 on hv-cinder-81803 Nov 19 03:20:48.362123 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-d8ab1879-c931-44b6-9437-b47722dc6504 req-b20f1c17-1687-47ad-ad6e-ce4730ce6953 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080455 Nov 19 03:20:48.363837 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 73/150] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:20:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:20:48.517888 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9a03528a-ae31-4157-98b3-48c9f806824f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:48.527036 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9a03528a-ae31-4157-98b3-48c9f806824f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:48.528795 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9a03528a-ae31-4157-98b3-48c9f806824f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:48.531634 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9a03528a-ae31-4157-98b3-48c9f806824f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.265869 Nov 19 03:20:48.542729 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 78/151] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:48 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:48.625917 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-de1d5419-9393-4252-8833-02b68c38446a tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:48.627060 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-de1d5419-9393-4252-8833-02b68c38446a tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:48.632809 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-de1d5419-9393-4252-8833-02b68c38446a tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:48.633258 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-de1d5419-9393-4252-8833-02b68c38446a tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:48.634037 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-de1d5419-9393-4252-8833-02b68c38446a tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:48.634491 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-de1d5419-9393-4252-8833-02b68c38446a tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:48.757904 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8d114e19-ead8-48f6-bc18-3c0d8c683e1d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:48.758440 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8d114e19-ead8-48f6-bc18-3c0d8c683e1d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:48.764494 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8d114e19-ead8-48f6-bc18-3c0d8c683e1d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:48.765518 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8d114e19-ead8-48f6-bc18-3c0d8c683e1d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:48.766298 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8d114e19-ead8-48f6-bc18-3c0d8c683e1d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:48.766809 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8d114e19-ead8-48f6-bc18-3c0d8c683e1d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:48.793109 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-de1d5419-9393-4252-8833-02b68c38446a tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:48.803148 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-de1d5419-9393-4252-8833-02b68c38446a tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.181713 Nov 19 03:20:48.804113 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 74/152] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:48 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:48.904789 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8d114e19-ead8-48f6-bc18-3c0d8c683e1d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:48.909981 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-67d5bf5d-2f0a-49ea-b9dd-19b2ab81101a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:48.910604 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-67d5bf5d-2f0a-49ea-b9dd-19b2ab81101a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:48.913520 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8d114e19-ead8-48f6-bc18-3c0d8c683e1d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.159118 Nov 19 03:20:48.914869 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 79/153] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:48 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:48.917239 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-67d5bf5d-2f0a-49ea-b9dd-19b2ab81101a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:48.917681 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-67d5bf5d-2f0a-49ea-b9dd-19b2ab81101a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:48.918501 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-67d5bf5d-2f0a-49ea-b9dd-19b2ab81101a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:48.918998 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-67d5bf5d-2f0a-49ea-b9dd-19b2ab81101a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:49.062889 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-67d5bf5d-2f0a-49ea-b9dd-19b2ab81101a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:49.078683 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-67d5bf5d-2f0a-49ea-b9dd-19b2ab81101a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.171883 Nov 19 03:20:49.079352 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 75/154] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:48 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:49.095628 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-cabd991b-0f2f-44ab-8571-e82c064405cb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:49.096598 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-cabd991b-0f2f-44ab-8571-e82c064405cb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:49.102992 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cabd991b-0f2f-44ab-8571-e82c064405cb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:49.103441 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cabd991b-0f2f-44ab-8571-e82c064405cb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:49.104220 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cabd991b-0f2f-44ab-8571-e82c064405cb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:49.104678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cabd991b-0f2f-44ab-8571-e82c064405cb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:49.244789 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-cabd991b-0f2f-44ab-8571-e82c064405cb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:49.252772 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-cabd991b-0f2f-44ab-8571-e82c064405cb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.161444 Nov 19 03:20:49.253554 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 80/155] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:49 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:49.552229 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a450300b-1445-4b0b-9391-a905c5a0ef03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:49.553020 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a450300b-1445-4b0b-9391-a905c5a0ef03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:49.559756 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a450300b-1445-4b0b-9391-a905c5a0ef03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:49.560547 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a450300b-1445-4b0b-9391-a905c5a0ef03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:49.561167 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a450300b-1445-4b0b-9391-a905c5a0ef03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:49.562258 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a450300b-1445-4b0b-9391-a905c5a0ef03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:49.720115 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-85fce656-abd7-4a2d-abfd-802785948027 req-cb2e145a-4672-4142-9204-4987964def96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19ae39a-79ce-4adb-9ee4-595daa1a8d27", "name": "network-vif-plugged", "status": "completed", "tag": "f3a1472b-becd-4a09-9300-3ef891038626"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:20:49.721679 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:20:49.721679 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:20:49.728943 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-85fce656-abd7-4a2d-abfd-802785948027 req-cb2e145a-4672-4142-9204-4987964def96 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:49.729422 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-85fce656-abd7-4a2d-abfd-802785948027 req-cb2e145a-4672-4142-9204-4987964def96 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:49.742652 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-85fce656-abd7-4a2d-abfd-802785948027 req-cb2e145a-4672-4142-9204-4987964def96 service nova] Creating event network-vif-plugged:f3a1472b-becd-4a09-9300-3ef891038626 for instance b19ae39a-79ce-4adb-9ee4-595daa1a8d27 on hv-cinder-81803 Nov 19 03:20:49.748350 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-85fce656-abd7-4a2d-abfd-802785948027 req-cb2e145a-4672-4142-9204-4987964def96 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110862 Nov 19 03:20:49.749648 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 81/156] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:20:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:20:49.785385 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a450300b-1445-4b0b-9391-a905c5a0ef03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:49.793864 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a450300b-1445-4b0b-9391-a905c5a0ef03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:49.798110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a450300b-1445-4b0b-9391-a905c5a0ef03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:49.799264 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a450300b-1445-4b0b-9391-a905c5a0ef03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.250921 Nov 19 03:20:49.801566 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 76/157] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:49 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:49.820593 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-98372fd8-f81f-4099-b2eb-d2148765ae91 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:49.821645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-98372fd8-f81f-4099-b2eb-d2148765ae91 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:49.829417 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-98372fd8-f81f-4099-b2eb-d2148765ae91 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:49.829871 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-98372fd8-f81f-4099-b2eb-d2148765ae91 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:49.830740 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-98372fd8-f81f-4099-b2eb-d2148765ae91 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:49.831385 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-98372fd8-f81f-4099-b2eb-d2148765ae91 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:49.941844 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-181335c2-62a6-4aa4-9cfc-3029d54c45a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:49.944579 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-181335c2-62a6-4aa4-9cfc-3029d54c45a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:49.962389 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-181335c2-62a6-4aa4-9cfc-3029d54c45a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:49.964653 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-181335c2-62a6-4aa4-9cfc-3029d54c45a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:49.967525 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-181335c2-62a6-4aa4-9cfc-3029d54c45a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:49.970287 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-181335c2-62a6-4aa4-9cfc-3029d54c45a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:50.066775 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-98372fd8-f81f-4099-b2eb-d2148765ae91 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:50.081412 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-98372fd8-f81f-4099-b2eb-d2148765ae91 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.265248 Nov 19 03:20:50.081997 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 82/158] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:49 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:50.099335 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ed13b048-f4d3-42fc-bbc0-b0e69548505c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:50.100769 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ed13b048-f4d3-42fc-bbc0-b0e69548505c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:50.109934 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ed13b048-f4d3-42fc-bbc0-b0e69548505c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:50.110682 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ed13b048-f4d3-42fc-bbc0-b0e69548505c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:50.111770 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ed13b048-f4d3-42fc-bbc0-b0e69548505c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:50.112504 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ed13b048-f4d3-42fc-bbc0-b0e69548505c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:50.201101 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-181335c2-62a6-4aa4-9cfc-3029d54c45a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:50.210704 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-181335c2-62a6-4aa4-9cfc-3029d54c45a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.282383 Nov 19 03:20:50.212003 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 77/159] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:49 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:50.271023 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2e5f124d-e258-455d-bc10-7f752ec4fb91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:50.272513 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2e5f124d-e258-455d-bc10-7f752ec4fb91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:50.280196 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2e5f124d-e258-455d-bc10-7f752ec4fb91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:50.281371 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2e5f124d-e258-455d-bc10-7f752ec4fb91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:50.282382 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2e5f124d-e258-455d-bc10-7f752ec4fb91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:50.283051 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2e5f124d-e258-455d-bc10-7f752ec4fb91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:50.302432 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ed13b048-f4d3-42fc-bbc0-b0e69548505c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:50.310675 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ed13b048-f4d3-42fc-bbc0-b0e69548505c tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.218230 Nov 19 03:20:50.311303 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 83/160] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:50 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:50.428774 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2e5f124d-e258-455d-bc10-7f752ec4fb91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:50.436012 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2e5f124d-e258-455d-bc10-7f752ec4fb91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.169792 Nov 19 03:20:50.436898 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 78/161] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:50 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:50.821306 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6613ab91-b36e-46b5-9b03-e01455afd23e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:50.821931 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6613ab91-b36e-46b5-9b03-e01455afd23e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:50.828288 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6613ab91-b36e-46b5-9b03-e01455afd23e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:50.828726 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6613ab91-b36e-46b5-9b03-e01455afd23e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:50.829654 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6613ab91-b36e-46b5-9b03-e01455afd23e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:50.830160 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6613ab91-b36e-46b5-9b03-e01455afd23e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:50.965573 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6613ab91-b36e-46b5-9b03-e01455afd23e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:50.974259 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6613ab91-b36e-46b5-9b03-e01455afd23e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:50.975862 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6613ab91-b36e-46b5-9b03-e01455afd23e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:50.977034 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6613ab91-b36e-46b5-9b03-e01455afd23e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.159846 Nov 19 03:20:50.977664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 84/162] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:50 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:51.098268 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a390dafa-900c-4711-ab94-e9c6a881ae97 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:51.099137 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a390dafa-900c-4711-ab94-e9c6a881ae97 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:51.110831 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a390dafa-900c-4711-ab94-e9c6a881ae97 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:51.111625 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a390dafa-900c-4711-ab94-e9c6a881ae97 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:51.112570 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a390dafa-900c-4711-ab94-e9c6a881ae97 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:51.114206 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a390dafa-900c-4711-ab94-e9c6a881ae97 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:51.231065 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7c7c9af3-3508-4b69-8413-17891fdedf61 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:51.240783 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7c7c9af3-3508-4b69-8413-17891fdedf61 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:51.240783 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c7c9af3-3508-4b69-8413-17891fdedf61 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:51.240783 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c7c9af3-3508-4b69-8413-17891fdedf61 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:51.240783 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c7c9af3-3508-4b69-8413-17891fdedf61 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:51.241249 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c7c9af3-3508-4b69-8413-17891fdedf61 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:51.346220 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a390dafa-900c-4711-ab94-e9c6a881ae97 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:51.359417 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a390dafa-900c-4711-ab94-e9c6a881ae97 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.263237 Nov 19 03:20:51.360299 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 79/163] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:51 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:51.376315 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-53262400-7c02-44da-b127-40f61e63ad34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:51.377014 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-53262400-7c02-44da-b127-40f61e63ad34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:51.384927 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-53262400-7c02-44da-b127-40f61e63ad34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:51.385565 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-53262400-7c02-44da-b127-40f61e63ad34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:51.386454 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-53262400-7c02-44da-b127-40f61e63ad34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:51.386959 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-53262400-7c02-44da-b127-40f61e63ad34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:51.520232 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7c7c9af3-3508-4b69-8413-17891fdedf61 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:51.531722 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7c7c9af3-3508-4b69-8413-17891fdedf61 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.303882 Nov 19 03:20:51.532698 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 85/164] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:51 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:51.545570 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-60627499-af07-4fce-803a-aa719aa9499e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:51.547994 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-60627499-af07-4fce-803a-aa719aa9499e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:51.563856 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-60627499-af07-4fce-803a-aa719aa9499e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:51.563856 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-60627499-af07-4fce-803a-aa719aa9499e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:51.565202 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-60627499-af07-4fce-803a-aa719aa9499e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:51.569093 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-60627499-af07-4fce-803a-aa719aa9499e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:51.706286 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-53262400-7c02-44da-b127-40f61e63ad34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:51.713660 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-53262400-7c02-44da-b127-40f61e63ad34 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.352160 Nov 19 03:20:51.721421 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 80/165] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:51 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:51.780544 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-7c276c3e-497b-45bf-b31b-00ad3f948789 req-dad70d23-2c9c-4e60-81c9-2288ea4be089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8", "name": "network-vif-plugged", "status": "completed", "tag": "0fcea7e8-8abe-4c82-990b-b3b5386e6d48"}, {"server_uuid": "c9ce8291-c6df-4afe-a958-5b8ef4c447fd", "name": "network-vif-plugged", "status": "completed", "tag": "564d4434-0349-4ca0-a3f4-f36410053f5a"}, {"server_uuid": "3c2fd56f-4c3a-4229-9b89-1f4c765c04d4", "name": "network-vif-plugged", "status": "completed", "tag": "e9c16595-10bc-456b-bed0-df7470f9741d"}, {"server_uuid": "8641ae42-77ad-4054-8073-76018892c1d8", "name": "network-vif-plugged", "status": "completed", "tag": "4b50d896-6a79-4185-a31c-1931a0b889be"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:20:51.782887 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:20:51.782887 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:20:51.794334 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-7c276c3e-497b-45bf-b31b-00ad3f948789 req-dad70d23-2c9c-4e60-81c9-2288ea4be089 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:51.795014 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-7c276c3e-497b-45bf-b31b-00ad3f948789 req-dad70d23-2c9c-4e60-81c9-2288ea4be089 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:51.810826 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-7c276c3e-497b-45bf-b31b-00ad3f948789 req-dad70d23-2c9c-4e60-81c9-2288ea4be089 service nova] Creating event network-vif-plugged:0fcea7e8-8abe-4c82-990b-b3b5386e6d48 for instance 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 on hv-cinder-81803 Nov 19 03:20:51.811329 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-7c276c3e-497b-45bf-b31b-00ad3f948789 req-dad70d23-2c9c-4e60-81c9-2288ea4be089 service nova] Creating event network-vif-plugged:564d4434-0349-4ca0-a3f4-f36410053f5a for instance c9ce8291-c6df-4afe-a958-5b8ef4c447fd on hv-cinder-81803 Nov 19 03:20:51.812595 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-7c276c3e-497b-45bf-b31b-00ad3f948789 req-dad70d23-2c9c-4e60-81c9-2288ea4be089 service nova] Creating event network-vif-plugged:e9c16595-10bc-456b-bed0-df7470f9741d for instance 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 on hv-cinder-81803 Nov 19 03:20:51.813389 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-7c276c3e-497b-45bf-b31b-00ad3f948789 req-dad70d23-2c9c-4e60-81c9-2288ea4be089 service nova] Creating event network-vif-plugged:4b50d896-6a79-4185-a31c-1931a0b889be for instance 8641ae42-77ad-4054-8073-76018892c1d8 on hv-cinder-81803 Nov 19 03:20:51.813800 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-60627499-af07-4fce-803a-aa719aa9499e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:51.821082 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-60627499-af07-4fce-803a-aa719aa9499e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.286086 Nov 19 03:20:51.822285 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 86/166] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:51 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:51.823297 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-7c276c3e-497b-45bf-b31b-00ad3f948789 req-dad70d23-2c9c-4e60-81c9-2288ea4be089 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.046542 Nov 19 03:20:51.824313 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 81/167] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:20:51 2021] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:20:51.996076 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e2629cc3-17dd-46bb-882b-e495e98615b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:51.996681 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e2629cc3-17dd-46bb-882b-e495e98615b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:52.005990 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e2629cc3-17dd-46bb-882b-e495e98615b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:52.006538 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e2629cc3-17dd-46bb-882b-e495e98615b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:52.007607 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e2629cc3-17dd-46bb-882b-e495e98615b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:52.008241 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e2629cc3-17dd-46bb-882b-e495e98615b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:52.188834 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e2629cc3-17dd-46bb-882b-e495e98615b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:52.199207 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e2629cc3-17dd-46bb-882b-e495e98615b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:52.201653 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e2629cc3-17dd-46bb-882b-e495e98615b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:52.203283 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e2629cc3-17dd-46bb-882b-e495e98615b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.211180 Nov 19 03:20:52.203781 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 87/168] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:51 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:52.377457 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2bd4fc17-a611-45f5-83f6-bb3a8d0b4649 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:52.378051 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2bd4fc17-a611-45f5-83f6-bb3a8d0b4649 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:52.385131 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2bd4fc17-a611-45f5-83f6-bb3a8d0b4649 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:52.385779 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2bd4fc17-a611-45f5-83f6-bb3a8d0b4649 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:52.386663 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2bd4fc17-a611-45f5-83f6-bb3a8d0b4649 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:52.387097 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2bd4fc17-a611-45f5-83f6-bb3a8d0b4649 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:52.548965 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-831679c2-e248-4326-b0d8-42e30e56f1de tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:52.549830 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-831679c2-e248-4326-b0d8-42e30e56f1de tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:52.555910 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-831679c2-e248-4326-b0d8-42e30e56f1de tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:52.556360 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-831679c2-e248-4326-b0d8-42e30e56f1de tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:52.557133 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-831679c2-e248-4326-b0d8-42e30e56f1de tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:52.557568 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-831679c2-e248-4326-b0d8-42e30e56f1de tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:52.761212 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2bd4fc17-a611-45f5-83f6-bb3a8d0b4649 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:52.771152 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2bd4fc17-a611-45f5-83f6-bb3a8d0b4649 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.398090 Nov 19 03:20:52.772788 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 82/169] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:52 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:52.778134 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-98e0c819-b776-4bc6-b433-288ae7b1bbbd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:52.779513 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-98e0c819-b776-4bc6-b433-288ae7b1bbbd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:52.787697 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98e0c819-b776-4bc6-b433-288ae7b1bbbd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:52.788499 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98e0c819-b776-4bc6-b433-288ae7b1bbbd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:52.789742 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98e0c819-b776-4bc6-b433-288ae7b1bbbd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:52.790386 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98e0c819-b776-4bc6-b433-288ae7b1bbbd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:52.825168 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-831679c2-e248-4326-b0d8-42e30e56f1de tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:52.833626 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-831679c2-e248-4326-b0d8-42e30e56f1de tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.288794 Nov 19 03:20:52.834262 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 88/170] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:52 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:52.848020 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-74b15381-2538-478e-aba7-5cadd432c539 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:52.849183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-74b15381-2538-478e-aba7-5cadd432c539 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:52.856378 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-74b15381-2538-478e-aba7-5cadd432c539 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:52.857102 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-74b15381-2538-478e-aba7-5cadd432c539 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:52.858223 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-74b15381-2538-478e-aba7-5cadd432c539 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:52.859934 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-74b15381-2538-478e-aba7-5cadd432c539 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:52.985065 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-98e0c819-b776-4bc6-b433-288ae7b1bbbd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:52.992798 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-98e0c819-b776-4bc6-b433-288ae7b1bbbd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.218599 Nov 19 03:20:52.993368 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 83/171] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:52 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:53.061276 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-74b15381-2538-478e-aba7-5cadd432c539 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:53.068973 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-74b15381-2538-478e-aba7-5cadd432c539 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.233068 Nov 19 03:20:53.070030 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 89/172] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:52 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:53.225044 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e1504c69-4477-46b6-bf2f-656f7e406c7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:53.225647 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e1504c69-4477-46b6-bf2f-656f7e406c7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:53.231581 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e1504c69-4477-46b6-bf2f-656f7e406c7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:53.231887 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e1504c69-4477-46b6-bf2f-656f7e406c7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:53.232739 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e1504c69-4477-46b6-bf2f-656f7e406c7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:53.233070 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e1504c69-4477-46b6-bf2f-656f7e406c7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:53.366756 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e1504c69-4477-46b6-bf2f-656f7e406c7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:53.374337 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e1504c69-4477-46b6-bf2f-656f7e406c7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:53.375842 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e1504c69-4477-46b6-bf2f-656f7e406c7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:53.376996 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e1504c69-4477-46b6-bf2f-656f7e406c7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.157397 Nov 19 03:20:53.377427 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 84/173] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:53 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:53.788882 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-779d21c6-b301-4c70-819c-9a512ac7c688 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:53.789622 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-779d21c6-b301-4c70-819c-9a512ac7c688 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:53.795575 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-779d21c6-b301-4c70-819c-9a512ac7c688 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:53.796631 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-779d21c6-b301-4c70-819c-9a512ac7c688 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:53.797720 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-779d21c6-b301-4c70-819c-9a512ac7c688 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:53.798169 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-779d21c6-b301-4c70-819c-9a512ac7c688 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:53.851905 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-34210da7-a706-47b9-9819-d576d0f912b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:53.852511 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-34210da7-a706-47b9-9819-d576d0f912b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:53.859835 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34210da7-a706-47b9-9819-d576d0f912b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:53.860483 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34210da7-a706-47b9-9819-d576d0f912b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:53.861542 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34210da7-a706-47b9-9819-d576d0f912b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:53.861969 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34210da7-a706-47b9-9819-d576d0f912b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:53.971360 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-779d21c6-b301-4c70-819c-9a512ac7c688 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:53.979552 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-779d21c6-b301-4c70-819c-9a512ac7c688 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.194401 Nov 19 03:20:53.980197 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 90/174] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:53 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:54.037218 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-34210da7-a706-47b9-9819-d576d0f912b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:54.044299 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-34210da7-a706-47b9-9819-d576d0f912b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.196783 Nov 19 03:20:54.044860 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 85/175] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:53 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:54.052864 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c86cba24-9b5d-404d-a3ba-e7d4a9d92669 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:54.054573 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c86cba24-9b5d-404d-a3ba-e7d4a9d92669 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:54.061277 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c86cba24-9b5d-404d-a3ba-e7d4a9d92669 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:54.061822 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c86cba24-9b5d-404d-a3ba-e7d4a9d92669 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:54.062622 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c86cba24-9b5d-404d-a3ba-e7d4a9d92669 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:54.063213 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c86cba24-9b5d-404d-a3ba-e7d4a9d92669 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:54.123408 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4b981e68-fa82-45d5-af7c-bcb193b4db9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:54.124689 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4b981e68-fa82-45d5-af7c-bcb193b4db9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:54.135400 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4b981e68-fa82-45d5-af7c-bcb193b4db9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:54.135942 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4b981e68-fa82-45d5-af7c-bcb193b4db9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:54.136782 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4b981e68-fa82-45d5-af7c-bcb193b4db9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:54.137286 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4b981e68-fa82-45d5-af7c-bcb193b4db9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:54.228782 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c86cba24-9b5d-404d-a3ba-e7d4a9d92669 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:54.245204 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c86cba24-9b5d-404d-a3ba-e7d4a9d92669 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.196325 Nov 19 03:20:54.245788 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 91/176] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:54 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:54.307054 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-4b981e68-fa82-45d5-af7c-bcb193b4db9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:54.315178 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4b981e68-fa82-45d5-af7c-bcb193b4db9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.195262 Nov 19 03:20:54.316524 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 86/177] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:54 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:54.393916 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-009476a1-a471-4e29-9ecb-44814fdf631b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:54.394549 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-009476a1-a471-4e29-9ecb-44814fdf631b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:54.404268 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-009476a1-a471-4e29-9ecb-44814fdf631b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:54.405081 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-009476a1-a471-4e29-9ecb-44814fdf631b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:54.406139 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-009476a1-a471-4e29-9ecb-44814fdf631b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:54.407144 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-009476a1-a471-4e29-9ecb-44814fdf631b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:54.560468 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-009476a1-a471-4e29-9ecb-44814fdf631b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:54.571155 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-009476a1-a471-4e29-9ecb-44814fdf631b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:54.572906 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-009476a1-a471-4e29-9ecb-44814fdf631b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:54.574010 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-009476a1-a471-4e29-9ecb-44814fdf631b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.184046 Nov 19 03:20:54.574801 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 92/178] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:54 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:54.996484 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-51a6850b-9b89-4d85-b309-b850b1db078d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:54.997164 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-51a6850b-9b89-4d85-b309-b850b1db078d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:55.004279 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51a6850b-9b89-4d85-b309-b850b1db078d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:55.004759 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51a6850b-9b89-4d85-b309-b850b1db078d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:55.005605 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51a6850b-9b89-4d85-b309-b850b1db078d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:55.006025 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51a6850b-9b89-4d85-b309-b850b1db078d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:55.067926 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7c3c3637-bbbb-46e8-906f-fd3a81009653 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:55.069135 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7c3c3637-bbbb-46e8-906f-fd3a81009653 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:55.081088 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c3c3637-bbbb-46e8-906f-fd3a81009653 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:55.081749 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c3c3637-bbbb-46e8-906f-fd3a81009653 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:55.082784 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c3c3637-bbbb-46e8-906f-fd3a81009653 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:55.083284 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c3c3637-bbbb-46e8-906f-fd3a81009653 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:55.184558 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-51a6850b-9b89-4d85-b309-b850b1db078d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:55.193179 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-51a6850b-9b89-4d85-b309-b850b1db078d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.200565 Nov 19 03:20:55.193757 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 87/179] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:54 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:55.248512 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7c3c3637-bbbb-46e8-906f-fd3a81009653 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:55.256620 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7c3c3637-bbbb-46e8-906f-fd3a81009653 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.194780 Nov 19 03:20:55.257185 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 93/180] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:55 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:55.262846 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f30474a4-cce8-416a-adf1-fa7c63354cd4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:55.263515 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f30474a4-cce8-416a-adf1-fa7c63354cd4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:55.269812 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f30474a4-cce8-416a-adf1-fa7c63354cd4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:55.270324 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f30474a4-cce8-416a-adf1-fa7c63354cd4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:55.271177 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f30474a4-cce8-416a-adf1-fa7c63354cd4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:55.271696 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f30474a4-cce8-416a-adf1-fa7c63354cd4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:55.344985 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-04a2530a-2726-4ef6-88a0-52f2abb72865 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:55.345678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-04a2530a-2726-4ef6-88a0-52f2abb72865 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:55.351647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-04a2530a-2726-4ef6-88a0-52f2abb72865 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:55.352164 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-04a2530a-2726-4ef6-88a0-52f2abb72865 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:55.353404 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-04a2530a-2726-4ef6-88a0-52f2abb72865 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:55.353845 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-04a2530a-2726-4ef6-88a0-52f2abb72865 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:55.438591 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-f30474a4-cce8-416a-adf1-fa7c63354cd4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:55.447167 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f30474a4-cce8-416a-adf1-fa7c63354cd4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.187772 Nov 19 03:20:55.458047 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 88/181] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:55 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:55.519652 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-04a2530a-2726-4ef6-88a0-52f2abb72865 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:55.527253 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-04a2530a-2726-4ef6-88a0-52f2abb72865 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.195730 Nov 19 03:20:55.537260 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 94/182] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:55 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:55.592445 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-612eb2dd-c55a-42fc-b00d-cb09a5dc5781 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:55.593602 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-612eb2dd-c55a-42fc-b00d-cb09a5dc5781 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:55.599490 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-612eb2dd-c55a-42fc-b00d-cb09a5dc5781 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:55.600033 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-612eb2dd-c55a-42fc-b00d-cb09a5dc5781 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:55.600801 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-612eb2dd-c55a-42fc-b00d-cb09a5dc5781 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:55.601228 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-612eb2dd-c55a-42fc-b00d-cb09a5dc5781 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:55.758189 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-612eb2dd-c55a-42fc-b00d-cb09a5dc5781 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:55.767190 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-612eb2dd-c55a-42fc-b00d-cb09a5dc5781 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:55.768967 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-612eb2dd-c55a-42fc-b00d-cb09a5dc5781 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:55.770350 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-612eb2dd-c55a-42fc-b00d-cb09a5dc5781 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.181340 Nov 19 03:20:55.770989 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 89/183] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:55 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:56.211349 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-71d3fe7a-66c6-4600-99cf-262f12aae32d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:56.211349 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-71d3fe7a-66c6-4600-99cf-262f12aae32d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:56.217420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71d3fe7a-66c6-4600-99cf-262f12aae32d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:56.218001 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71d3fe7a-66c6-4600-99cf-262f12aae32d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:56.218890 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71d3fe7a-66c6-4600-99cf-262f12aae32d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:56.219538 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71d3fe7a-66c6-4600-99cf-262f12aae32d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:56.273786 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d5562cf5-bfe4-4fa5-b1ca-58d6d9abcb42 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:56.274290 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d5562cf5-bfe4-4fa5-b1ca-58d6d9abcb42 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:56.280628 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d5562cf5-bfe4-4fa5-b1ca-58d6d9abcb42 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:56.281420 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d5562cf5-bfe4-4fa5-b1ca-58d6d9abcb42 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:56.282222 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d5562cf5-bfe4-4fa5-b1ca-58d6d9abcb42 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:56.282840 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d5562cf5-bfe4-4fa5-b1ca-58d6d9abcb42 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:56.392175 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-71d3fe7a-66c6-4600-99cf-262f12aae32d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:56.399762 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-71d3fe7a-66c6-4600-99cf-262f12aae32d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.193175 Nov 19 03:20:56.400517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 95/184] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:56 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:56.464787 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-68eca66f-5782-419a-a7c6-37571946b9cd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:56.465394 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-68eca66f-5782-419a-a7c6-37571946b9cd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:56.470988 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d5562cf5-bfe4-4fa5-b1ca-58d6d9abcb42 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:56.471870 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-68eca66f-5782-419a-a7c6-37571946b9cd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:56.472425 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-68eca66f-5782-419a-a7c6-37571946b9cd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:56.473425 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-68eca66f-5782-419a-a7c6-37571946b9cd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:56.473971 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-68eca66f-5782-419a-a7c6-37571946b9cd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:56.478420 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d5562cf5-bfe4-4fa5-b1ca-58d6d9abcb42 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.208920 Nov 19 03:20:56.479181 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 90/185] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:56 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:56.544690 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c2a363cb-0f9a-44c2-b1fd-0185c5768c52 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:56.545443 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c2a363cb-0f9a-44c2-b1fd-0185c5768c52 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:56.553125 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c2a363cb-0f9a-44c2-b1fd-0185c5768c52 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:56.553650 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c2a363cb-0f9a-44c2-b1fd-0185c5768c52 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:56.554497 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c2a363cb-0f9a-44c2-b1fd-0185c5768c52 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:56.554994 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c2a363cb-0f9a-44c2-b1fd-0185c5768c52 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:56.643181 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-68eca66f-5782-419a-a7c6-37571946b9cd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:56.652097 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-68eca66f-5782-419a-a7c6-37571946b9cd tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.190835 Nov 19 03:20:56.652686 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 96/186] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:56 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:56.705748 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c2a363cb-0f9a-44c2-b1fd-0185c5768c52 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:56.713048 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c2a363cb-0f9a-44c2-b1fd-0185c5768c52 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.172009 Nov 19 03:20:56.713607 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 91/187] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:56 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:56.788254 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b1b5edf8-f5da-4393-b81e-495c030ce1c9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:56.788848 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b1b5edf8-f5da-4393-b81e-495c030ce1c9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:56.794463 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b1b5edf8-f5da-4393-b81e-495c030ce1c9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:56.795000 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b1b5edf8-f5da-4393-b81e-495c030ce1c9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:56.795707 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b1b5edf8-f5da-4393-b81e-495c030ce1c9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:56.796807 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b1b5edf8-f5da-4393-b81e-495c030ce1c9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:56.925958 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b1b5edf8-f5da-4393-b81e-495c030ce1c9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:56.934362 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b1b5edf8-f5da-4393-b81e-495c030ce1c9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:56.935882 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b1b5edf8-f5da-4393-b81e-495c030ce1c9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:56.937515 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b1b5edf8-f5da-4393-b81e-495c030ce1c9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.152922 Nov 19 03:20:56.938250 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 97/188] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:56 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:57.416302 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-bf8ba997-8612-471c-a8fa-bf98868a30fd tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:57.417427 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-bf8ba997-8612-471c-a8fa-bf98868a30fd tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:57.424015 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bf8ba997-8612-471c-a8fa-bf98868a30fd tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:57.424468 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bf8ba997-8612-471c-a8fa-bf98868a30fd tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:57.425244 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bf8ba997-8612-471c-a8fa-bf98868a30fd tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:57.425672 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bf8ba997-8612-471c-a8fa-bf98868a30fd tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:57.495795 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d23c924e-2e72-4eb9-8eff-026b28177229 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:57.496967 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d23c924e-2e72-4eb9-8eff-026b28177229 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:57.504421 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d23c924e-2e72-4eb9-8eff-026b28177229 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:57.504871 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d23c924e-2e72-4eb9-8eff-026b28177229 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:57.505658 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d23c924e-2e72-4eb9-8eff-026b28177229 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:57.506078 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d23c924e-2e72-4eb9-8eff-026b28177229 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:57.827590 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-bf8ba997-8612-471c-a8fa-bf98868a30fd tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:57.835233 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-bf8ba997-8612-471c-a8fa-bf98868a30fd tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.422411 Nov 19 03:20:57.835953 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 92/189] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:57 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:57.840675 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-25d4e025-a6d5-44ea-9246-2f2b871542ac tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:57.841261 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-25d4e025-a6d5-44ea-9246-2f2b871542ac tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:57.847709 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-25d4e025-a6d5-44ea-9246-2f2b871542ac tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:57.848450 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-25d4e025-a6d5-44ea-9246-2f2b871542ac tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:57.848977 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d23c924e-2e72-4eb9-8eff-026b28177229 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:57.849402 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-25d4e025-a6d5-44ea-9246-2f2b871542ac tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:57.849912 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-25d4e025-a6d5-44ea-9246-2f2b871542ac tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:57.858831 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d23c924e-2e72-4eb9-8eff-026b28177229 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.366522 Nov 19 03:20:57.860120 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 98/190] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:57 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:57.864670 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-216508d0-38b5-48b8-95b8-016d1324bfad tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:57.865344 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-216508d0-38b5-48b8-95b8-016d1324bfad tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:57.872941 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-216508d0-38b5-48b8-95b8-016d1324bfad tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:57.873867 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-216508d0-38b5-48b8-95b8-016d1324bfad tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:57.875797 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-216508d0-38b5-48b8-95b8-016d1324bfad tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:57.876410 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-216508d0-38b5-48b8-95b8-016d1324bfad tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:58.076933 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-25d4e025-a6d5-44ea-9246-2f2b871542ac tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:58.084491 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-25d4e025-a6d5-44ea-9246-2f2b871542ac tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.247412 Nov 19 03:20:58.084635 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-216508d0-38b5-48b8-95b8-016d1324bfad tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:58.085253 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 93/191] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:57 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:58.089954 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ffebd5ad-a7ed-41eb-91cc-9d4562091dbd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:58.090657 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ffebd5ad-a7ed-41eb-91cc-9d4562091dbd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:58.096651 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ffebd5ad-a7ed-41eb-91cc-9d4562091dbd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:58.096938 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-216508d0-38b5-48b8-95b8-016d1324bfad tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.235488 Nov 19 03:20:58.097096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ffebd5ad-a7ed-41eb-91cc-9d4562091dbd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:58.097510 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 99/192] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:57 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:58.098075 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ffebd5ad-a7ed-41eb-91cc-9d4562091dbd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:58.098530 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ffebd5ad-a7ed-41eb-91cc-9d4562091dbd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:58.233228 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ffebd5ad-a7ed-41eb-91cc-9d4562091dbd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:58.240966 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ffebd5ad-a7ed-41eb-91cc-9d4562091dbd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:58.242445 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ffebd5ad-a7ed-41eb-91cc-9d4562091dbd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:58.243550 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ffebd5ad-a7ed-41eb-91cc-9d4562091dbd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.157301 Nov 19 03:20:58.244104 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 94/193] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:58 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:20:58.852166 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-779389b7-3eb5-4200-af69-c7070b47551d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:58.852797 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-779389b7-3eb5-4200-af69-c7070b47551d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:58.859739 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-779389b7-3eb5-4200-af69-c7070b47551d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:58.860182 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-779389b7-3eb5-4200-af69-c7070b47551d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:58.860950 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-779389b7-3eb5-4200-af69-c7070b47551d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:58.861382 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-779389b7-3eb5-4200-af69-c7070b47551d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:58.877124 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f3f09ef1-ddf6-4a5d-8843-7512fe2cc27a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:58.877906 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f3f09ef1-ddf6-4a5d-8843-7512fe2cc27a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:58.883780 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f3f09ef1-ddf6-4a5d-8843-7512fe2cc27a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:58.884227 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f3f09ef1-ddf6-4a5d-8843-7512fe2cc27a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:58.885003 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f3f09ef1-ddf6-4a5d-8843-7512fe2cc27a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:58.885431 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f3f09ef1-ddf6-4a5d-8843-7512fe2cc27a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:59.056191 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-779389b7-3eb5-4200-af69-c7070b47551d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:59.064133 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-779389b7-3eb5-4200-af69-c7070b47551d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.215497 Nov 19 03:20:59.064820 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 100/194] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:58 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:59.069555 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-f3f09ef1-ddf6-4a5d-8843-7512fe2cc27a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:59.076778 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f3f09ef1-ddf6-4a5d-8843-7512fe2cc27a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.204122 Nov 19 03:20:59.077372 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 95/195] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:58 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:20:59.100926 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-99f83c49-8b2b-48ab-b892-292990757304 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:59.101524 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-99f83c49-8b2b-48ab-b892-292990757304 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:59.107452 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-99f83c49-8b2b-48ab-b892-292990757304 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:59.107891 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-99f83c49-8b2b-48ab-b892-292990757304 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:59.109520 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-99f83c49-8b2b-48ab-b892-292990757304 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:59.109948 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-99f83c49-8b2b-48ab-b892-292990757304 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:59.116236 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-34787c9e-c3c5-4c43-9ffe-dc3ec99569a3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:59.116903 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-34787c9e-c3c5-4c43-9ffe-dc3ec99569a3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:59.122679 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34787c9e-c3c5-4c43-9ffe-dc3ec99569a3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:59.123297 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34787c9e-c3c5-4c43-9ffe-dc3ec99569a3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:59.124358 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34787c9e-c3c5-4c43-9ffe-dc3ec99569a3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:59.124784 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34787c9e-c3c5-4c43-9ffe-dc3ec99569a3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:59.332453 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-99f83c49-8b2b-48ab-b892-292990757304 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:59.339999 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-99f83c49-8b2b-48ab-b892-292990757304 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.242596 Nov 19 03:20:59.341128 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 101/196] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:59 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:59.344544 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-34787c9e-c3c5-4c43-9ffe-dc3ec99569a3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:59.346462 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-97179530-06d7-4c7a-b90a-76e83eaee064 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:20:59.347317 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-97179530-06d7-4c7a-b90a-76e83eaee064 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:20:59.353531 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97179530-06d7-4c7a-b90a-76e83eaee064 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:59.354266 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97179530-06d7-4c7a-b90a-76e83eaee064 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:59.355275 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97179530-06d7-4c7a-b90a-76e83eaee064 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:20:59.355918 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97179530-06d7-4c7a-b90a-76e83eaee064 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:20:59.357838 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-34787c9e-c3c5-4c43-9ffe-dc3ec99569a3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.245000 Nov 19 03:20:59.359438 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 96/197] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:20:59 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:20:59.495102 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-97179530-06d7-4c7a-b90a-76e83eaee064 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:59.502911 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-97179530-06d7-4c7a-b90a-76e83eaee064 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:59.504397 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-97179530-06d7-4c7a-b90a-76e83eaee064 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:20:59.505487 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-97179530-06d7-4c7a-b90a-76e83eaee064 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.163237 Nov 19 03:20:59.506225 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 102/198] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:20:59 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:21:00.085509 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-706d8e01-6b05-436c-b250-12dcb900f50b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:00.086139 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-706d8e01-6b05-436c-b250-12dcb900f50b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:00.092386 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-706d8e01-6b05-436c-b250-12dcb900f50b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:00.092902 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-706d8e01-6b05-436c-b250-12dcb900f50b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:00.093786 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-706d8e01-6b05-436c-b250-12dcb900f50b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:00.094245 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-706d8e01-6b05-436c-b250-12dcb900f50b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:00.095115 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-679585de-7d5b-42e7-bc0a-8a250dd044b8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:00.096139 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-679585de-7d5b-42e7-bc0a-8a250dd044b8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:00.104663 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-679585de-7d5b-42e7-bc0a-8a250dd044b8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:00.105331 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-679585de-7d5b-42e7-bc0a-8a250dd044b8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:00.106107 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-679585de-7d5b-42e7-bc0a-8a250dd044b8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:00.106557 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-679585de-7d5b-42e7-bc0a-8a250dd044b8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:00.293769 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-706d8e01-6b05-436c-b250-12dcb900f50b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:00.301496 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-706d8e01-6b05-436c-b250-12dcb900f50b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.219748 Nov 19 03:21:00.302189 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 97/199] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:00 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:00.313364 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-679585de-7d5b-42e7-bc0a-8a250dd044b8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:00.321892 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-679585de-7d5b-42e7-bc0a-8a250dd044b8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.232257 Nov 19 03:21:00.322855 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 103/200] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:00 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:00.357900 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-be871ae4-9621-415b-ba57-d4ac98c548fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:00.358609 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-be871ae4-9621-415b-ba57-d4ac98c548fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:00.364661 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be871ae4-9621-415b-ba57-d4ac98c548fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:00.365150 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be871ae4-9621-415b-ba57-d4ac98c548fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:00.366124 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be871ae4-9621-415b-ba57-d4ac98c548fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:00.366716 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be871ae4-9621-415b-ba57-d4ac98c548fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:00.383474 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-dfcce92f-5663-4837-a2ee-44c59080566b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:00.384260 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-dfcce92f-5663-4837-a2ee-44c59080566b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:00.390741 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dfcce92f-5663-4837-a2ee-44c59080566b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:00.391457 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dfcce92f-5663-4837-a2ee-44c59080566b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:00.392539 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dfcce92f-5663-4837-a2ee-44c59080566b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:00.393104 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dfcce92f-5663-4837-a2ee-44c59080566b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:00.575637 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-be871ae4-9621-415b-ba57-d4ac98c548fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:00.581776 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-be871ae4-9621-415b-ba57-d4ac98c548fe tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.227398 Nov 19 03:21:00.582337 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 98/201] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:00 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:00.586594 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-37ed7ad9-48e3-4179-856a-88e4682f2348 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:00.587491 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-37ed7ad9-48e3-4179-856a-88e4682f2348 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:00.593727 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-37ed7ad9-48e3-4179-856a-88e4682f2348 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:00.594259 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-37ed7ad9-48e3-4179-856a-88e4682f2348 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:00.595132 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-37ed7ad9-48e3-4179-856a-88e4682f2348 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:00.595563 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-37ed7ad9-48e3-4179-856a-88e4682f2348 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:00.603870 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-dfcce92f-5663-4837-a2ee-44c59080566b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:00.612125 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-dfcce92f-5663-4837-a2ee-44c59080566b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.234013 Nov 19 03:21:00.613125 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 104/202] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:00 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:00.739173 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-37ed7ad9-48e3-4179-856a-88e4682f2348 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:00.747213 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-37ed7ad9-48e3-4179-856a-88e4682f2348 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:00.748667 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-37ed7ad9-48e3-4179-856a-88e4682f2348 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:00.750243 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-37ed7ad9-48e3-4179-856a-88e4682f2348 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1406 microversion: 2.20 time: 0.166984 Nov 19 03:21:00.750830 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 99/203] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:21:00 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:21:01.318898 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f5eb11f3-34d5-4e1e-9154-1f083dd1be9b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:01.319502 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f5eb11f3-34d5-4e1e-9154-1f083dd1be9b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:01.325338 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f5eb11f3-34d5-4e1e-9154-1f083dd1be9b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:01.325782 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f5eb11f3-34d5-4e1e-9154-1f083dd1be9b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:01.326576 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f5eb11f3-34d5-4e1e-9154-1f083dd1be9b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:01.327158 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f5eb11f3-34d5-4e1e-9154-1f083dd1be9b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:01.338668 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-dacae04a-db6a-4908-bd60-ecdb36a1c932 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:01.339265 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-dacae04a-db6a-4908-bd60-ecdb36a1c932 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:01.345781 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dacae04a-db6a-4908-bd60-ecdb36a1c932 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:01.346220 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dacae04a-db6a-4908-bd60-ecdb36a1c932 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:01.347014 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dacae04a-db6a-4908-bd60-ecdb36a1c932 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:01.348053 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dacae04a-db6a-4908-bd60-ecdb36a1c932 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:01.532043 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f5eb11f3-34d5-4e1e-9154-1f083dd1be9b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:01.541759 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-dacae04a-db6a-4908-bd60-ecdb36a1c932 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:01.544391 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f5eb11f3-34d5-4e1e-9154-1f083dd1be9b tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.228851 Nov 19 03:21:01.545391 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 105/204] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:01 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:01.560036 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-dacae04a-db6a-4908-bd60-ecdb36a1c932 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.223450 Nov 19 03:21:01.560036 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 100/205] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:01 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:01.603478 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6d94f85a-6abd-4f25-b5f2-fb97871d4996 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:01.604396 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6d94f85a-6abd-4f25-b5f2-fb97871d4996 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:01.615125 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6d94f85a-6abd-4f25-b5f2-fb97871d4996 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:01.615623 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6d94f85a-6abd-4f25-b5f2-fb97871d4996 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:01.616742 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6d94f85a-6abd-4f25-b5f2-fb97871d4996 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:01.617387 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6d94f85a-6abd-4f25-b5f2-fb97871d4996 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:01.634624 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-deb45ebc-38c6-474e-bf4f-e519ea93b9c2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:01.635533 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-deb45ebc-38c6-474e-bf4f-e519ea93b9c2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:01.645358 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-deb45ebc-38c6-474e-bf4f-e519ea93b9c2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:01.646048 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-deb45ebc-38c6-474e-bf4f-e519ea93b9c2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:01.647052 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-deb45ebc-38c6-474e-bf4f-e519ea93b9c2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:01.647952 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-deb45ebc-38c6-474e-bf4f-e519ea93b9c2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:01.875233 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6d94f85a-6abd-4f25-b5f2-fb97871d4996 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:01.882718 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6d94f85a-6abd-4f25-b5f2-fb97871d4996 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1314 microversion: 2.1 time: 0.287195 Nov 19 03:21:01.892793 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 106/206] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:01 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:01.892793 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-de2c5f75-2722-42f6-b1a7-30ee65c5c1e4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:01.892793 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-de2c5f75-2722-42f6-b1a7-30ee65c5c1e4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:01.895147 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-de2c5f75-2722-42f6-b1a7-30ee65c5c1e4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:01.895962 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-de2c5f75-2722-42f6-b1a7-30ee65c5c1e4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:01.896383 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-de2c5f75-2722-42f6-b1a7-30ee65c5c1e4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:01.896813 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-de2c5f75-2722-42f6-b1a7-30ee65c5c1e4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:01.909104 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-deb45ebc-38c6-474e-bf4f-e519ea93b9c2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:01.917563 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-deb45ebc-38c6-474e-bf4f-e519ea93b9c2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1316 microversion: 2.1 time: 0.289345 Nov 19 03:21:01.917563 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 101/207] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:01 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:02.044527 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-de2c5f75-2722-42f6-b1a7-30ee65c5c1e4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:02.053164 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-de2c5f75-2722-42f6-b1a7-30ee65c5c1e4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:02.054678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-de2c5f75-2722-42f6-b1a7-30ee65c5c1e4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:02.055817 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-de2c5f75-2722-42f6-b1a7-30ee65c5c1e4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1597 microversion: 2.20 time: 0.171111 Nov 19 03:21:02.056368 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 107/208] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:21:01 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1597 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:21:02.073851 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c57a6ac4-bf56-47ec-a872-30d7d5736d28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:02.074261 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c57a6ac4-bf56-47ec-a872-30d7d5736d28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:02.080518 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c57a6ac4-bf56-47ec-a872-30d7d5736d28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:02.080967 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c57a6ac4-bf56-47ec-a872-30d7d5736d28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:02.081746 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c57a6ac4-bf56-47ec-a872-30d7d5736d28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:02.082180 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c57a6ac4-bf56-47ec-a872-30d7d5736d28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:02.226219 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c57a6ac4-bf56-47ec-a872-30d7d5736d28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.156069 Nov 19 03:21:02.227019 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 102/209] 10.222.0.47 () {60 vars in 1315 bytes} [Fri Nov 19 03:21:02 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:21:02.561074 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d911cb6f-8f82-47b5-b64f-a83bdc032555 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:02.562741 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d911cb6f-8f82-47b5-b64f-a83bdc032555 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:02.569581 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d911cb6f-8f82-47b5-b64f-a83bdc032555 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:02.570115 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d911cb6f-8f82-47b5-b64f-a83bdc032555 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:02.571023 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d911cb6f-8f82-47b5-b64f-a83bdc032555 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:02.571724 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d911cb6f-8f82-47b5-b64f-a83bdc032555 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:02.576559 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-83ca201e-6a05-49aa-b8d8-8a12f33b39ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:02.578699 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-83ca201e-6a05-49aa-b8d8-8a12f33b39ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:02.585402 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-83ca201e-6a05-49aa-b8d8-8a12f33b39ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:02.586097 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-83ca201e-6a05-49aa-b8d8-8a12f33b39ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:02.587097 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-83ca201e-6a05-49aa-b8d8-8a12f33b39ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:02.587761 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-83ca201e-6a05-49aa-b8d8-8a12f33b39ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:03.364669 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-83ca201e-6a05-49aa-b8d8-8a12f33b39ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:03.372573 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-83ca201e-6a05-49aa-b8d8-8a12f33b39ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1322 microversion: 2.1 time: 0.800067 Nov 19 03:21:03.373161 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 103/210] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:02 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1322 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:03.386411 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c204a8e6-35c7-4e0f-8a92-7f6afb3c03de tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:03.387343 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c204a8e6-35c7-4e0f-8a92-7f6afb3c03de tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:03.394284 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c204a8e6-35c7-4e0f-8a92-7f6afb3c03de tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:03.395101 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c204a8e6-35c7-4e0f-8a92-7f6afb3c03de tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:03.396477 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c204a8e6-35c7-4e0f-8a92-7f6afb3c03de tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:03.397367 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c204a8e6-35c7-4e0f-8a92-7f6afb3c03de tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:03.431246 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d911cb6f-8f82-47b5-b64f-a83bdc032555 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:03.443465 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d911cb6f-8f82-47b5-b64f-a83bdc032555 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.885870 Nov 19 03:21:03.444891 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 108/211] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:02 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:03.460287 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d1f0c8ad-3b99-448b-bd2b-7a92ddec673a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:03.461200 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d1f0c8ad-3b99-448b-bd2b-7a92ddec673a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:03.468752 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d1f0c8ad-3b99-448b-bd2b-7a92ddec673a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:03.469504 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d1f0c8ad-3b99-448b-bd2b-7a92ddec673a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:03.472637 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d1f0c8ad-3b99-448b-bd2b-7a92ddec673a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:03.473100 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d1f0c8ad-3b99-448b-bd2b-7a92ddec673a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:03.873618 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c204a8e6-35c7-4e0f-8a92-7f6afb3c03de tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:03.882306 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c204a8e6-35c7-4e0f-8a92-7f6afb3c03de tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1500 microversion: 2.1 time: 0.507721 Nov 19 03:21:03.882909 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 104/212] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:03 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1500 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:03.896051 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-6def01b2-4695-4545-937c-f9738d3a641a req-5d16971d-aad5-4090-8f5e-8cc96ff4c5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d668ca76-7d13-479a-81de-3fb38e242812", "name": "network-vif-plugged", "status": "completed", "tag": "314c6c6f-8af0-4b27-9cbd-6de5ea3bc3f6"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:03.897956 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:21:03.897956 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:21:03.906278 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-6def01b2-4695-4545-937c-f9738d3a641a req-5d16971d-aad5-4090-8f5e-8cc96ff4c5aa service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:03.906744 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-6def01b2-4695-4545-937c-f9738d3a641a req-5d16971d-aad5-4090-8f5e-8cc96ff4c5aa service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:03.928306 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-6def01b2-4695-4545-937c-f9738d3a641a req-5d16971d-aad5-4090-8f5e-8cc96ff4c5aa service nova] Creating event network-vif-plugged:314c6c6f-8af0-4b27-9cbd-6de5ea3bc3f6 for instance d668ca76-7d13-479a-81de-3fb38e242812 on hv-cinder-81803 Nov 19 03:21:03.935596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-6def01b2-4695-4545-937c-f9738d3a641a req-5d16971d-aad5-4090-8f5e-8cc96ff4c5aa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049755 Nov 19 03:21:03.953274 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 105/213] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:21:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:21:03.996816 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d1f0c8ad-3b99-448b-bd2b-7a92ddec673a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:04.004670 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d1f0c8ad-3b99-448b-bd2b-7a92ddec673a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1506 microversion: 2.1 time: 0.558389 Nov 19 03:21:04.024401 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 109/214] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:03 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1506 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:04.389317 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-fa1ec716-5633-4682-91bf-44e8092e1f08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:04.390237 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-fa1ec716-5633-4682-91bf-44e8092e1f08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:04.406005 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fa1ec716-5633-4682-91bf-44e8092e1f08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:04.406446 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fa1ec716-5633-4682-91bf-44e8092e1f08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:04.407254 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fa1ec716-5633-4682-91bf-44e8092e1f08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:04.407678 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fa1ec716-5633-4682-91bf-44e8092e1f08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:04.461132 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b828b278-6dd7-4e08-bd9c-b726df042f78 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:04.461737 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b828b278-6dd7-4e08-bd9c-b726df042f78 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:04.473407 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b828b278-6dd7-4e08-bd9c-b726df042f78 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:04.473850 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b828b278-6dd7-4e08-bd9c-b726df042f78 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:04.474672 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b828b278-6dd7-4e08-bd9c-b726df042f78 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:04.478273 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b828b278-6dd7-4e08-bd9c-b726df042f78 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:04.876926 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-fa1ec716-5633-4682-91bf-44e8092e1f08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:04.889054 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b828b278-6dd7-4e08-bd9c-b726df042f78 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:04.892783 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-fa1ec716-5633-4682-91bf-44e8092e1f08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1517 microversion: 2.1 time: 0.507251 Nov 19 03:21:04.893366 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 106/215] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:04 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1517 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:04.898125 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3d43c154-6c10-4da5-a255-cd12dc852563 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:04.899047 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3d43c154-6c10-4da5-a255-cd12dc852563 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:04.899518 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b828b278-6dd7-4e08-bd9c-b726df042f78 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.441921 Nov 19 03:21:04.900285 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 110/216] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:04 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:04.906532 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-1d6991ee-423a-4c08-bb8e-9678348e3ec3 req-fe3cfba6-a10c-4181-96c4-c75ef9b02303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8641ae42-77ad-4054-8073-76018892c1d8", "tag": "4b50d896-6a79-4185-a31c-1931a0b889be"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:04.908368 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:21:04.908368 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:21:04.917330 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-1d6991ee-423a-4c08-bb8e-9678348e3ec3 req-fe3cfba6-a10c-4181-96c4-c75ef9b02303 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:04.917822 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3d43c154-6c10-4da5-a255-cd12dc852563 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:04.917938 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-1d6991ee-423a-4c08-bb8e-9678348e3ec3 req-fe3cfba6-a10c-4181-96c4-c75ef9b02303 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:04.918269 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3d43c154-6c10-4da5-a255-cd12dc852563 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:04.919075 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3d43c154-6c10-4da5-a255-cd12dc852563 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:04.919658 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3d43c154-6c10-4da5-a255-cd12dc852563 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:04.933820 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-1d6991ee-423a-4c08-bb8e-9678348e3ec3 req-fe3cfba6-a10c-4181-96c4-c75ef9b02303 service nova] Creating event network-changed:4b50d896-6a79-4185-a31c-1931a0b889be for instance 8641ae42-77ad-4054-8073-76018892c1d8 on hv-cinder-81803 Nov 19 03:21:04.940789 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-1d6991ee-423a-4c08-bb8e-9678348e3ec3 req-fe3cfba6-a10c-4181-96c4-c75ef9b02303 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038559 Nov 19 03:21:04.942379 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 111/217] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:21:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:21:04.950595 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b492e8a3-c729-409f-8f3e-165915c33adb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:04.952554 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b492e8a3-c729-409f-8f3e-165915c33adb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:04.959346 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b492e8a3-c729-409f-8f3e-165915c33adb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:04.959994 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b492e8a3-c729-409f-8f3e-165915c33adb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:04.961539 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b492e8a3-c729-409f-8f3e-165915c33adb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:04.962214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b492e8a3-c729-409f-8f3e-165915c33adb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:05.040605 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-b492e8a3-c729-409f-8f3e-165915c33adb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'flavor' on Instance uuid 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:21:05.145611 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3d43c154-6c10-4da5-a255-cd12dc852563 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 14 microversion: 2.20 time: 0.250952 Nov 19 03:21:05.146926 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 107/218] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:04 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 14 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:05.232612 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b492e8a3-c729-409f-8f3e-165915c33adb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "POST /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8/action" status: 200 len: 32 microversion: 2.1 time: 0.288450 Nov 19 03:21:05.233325 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 112/219] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:21:04 2021] POST /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8/action => generated 32 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:21:05.243776 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7ebd1dfa-5564-4ffd-8ac7-b94628a326b4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:05.244576 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7ebd1dfa-5564-4ffd-8ac7-b94628a326b4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:05.274109 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7ebd1dfa-5564-4ffd-8ac7-b94628a326b4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:05.274994 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7ebd1dfa-5564-4ffd-8ac7-b94628a326b4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:05.276164 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7ebd1dfa-5564-4ffd-8ac7-b94628a326b4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:05.277076 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7ebd1dfa-5564-4ffd-8ac7-b94628a326b4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:05.499941 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3b91fdde-c5fb-41ac-a896-a142ff46a6a4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c63dce8-79b2-409c-8a7a-0e9b1c1ba604"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:05.501882 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3b91fdde-c5fb-41ac-a896-a142ff46a6a4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:05.517491 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3b91fdde-c5fb-41ac-a896-a142ff46a6a4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:05.519591 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3b91fdde-c5fb-41ac-a896-a142ff46a6a4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:05.523151 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3b91fdde-c5fb-41ac-a896-a142ff46a6a4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:05.523792 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3b91fdde-c5fb-41ac-a896-a142ff46a6a4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:05.884010 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-7ebd1dfa-5564-4ffd-8ac7-b94628a326b4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:05.893661 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7ebd1dfa-5564-4ffd-8ac7-b94628a326b4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.654602 Nov 19 03:21:05.906346 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 108/220] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:05 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:05.928427 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3a57f91d-af1f-484d-8d86-29abad897210 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:05.931040 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3a57f91d-af1f-484d-8d86-29abad897210 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:05.941704 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3a57f91d-af1f-484d-8d86-29abad897210 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:05.942998 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3a57f91d-af1f-484d-8d86-29abad897210 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:05.943994 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3a57f91d-af1f-484d-8d86-29abad897210 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:05.945063 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3a57f91d-af1f-484d-8d86-29abad897210 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:06.257593 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3b91fdde-c5fb-41ac-a896-a142ff46a6a4 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "POST /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.763189 Nov 19 03:21:06.262001 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 113/221] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:21:05 2021] POST /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd/os-volume_attachments => generated 194 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:21:06.280656 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-fa974952-926d-4a73-9c59-2855d98a446d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:06.282598 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-fa974952-926d-4a73-9c59-2855d98a446d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:06.291104 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fa974952-926d-4a73-9c59-2855d98a446d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:06.292121 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fa974952-926d-4a73-9c59-2855d98a446d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:06.293595 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fa974952-926d-4a73-9c59-2855d98a446d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:06.301218 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fa974952-926d-4a73-9c59-2855d98a446d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:06.330930 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-3a57f91d-af1f-484d-8d86-29abad897210 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:06.339119 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3a57f91d-af1f-484d-8d86-29abad897210 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1314 microversion: 2.1 time: 0.422522 Nov 19 03:21:06.339883 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 109/222] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:05 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:06.621208 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-fa974952-926d-4a73-9c59-2855d98a446d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 14 microversion: 2.20 time: 0.348276 Nov 19 03:21:06.631091 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 114/223] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:06 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 14 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:06.853820 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-549c7c78-04f7-443e-9d95-9e700e151f0c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c77155b1-aeba-41af-b24a-fd6c1877ba51"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:06.855850 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-549c7c78-04f7-443e-9d95-9e700e151f0c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:06.866626 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-549c7c78-04f7-443e-9d95-9e700e151f0c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:06.867041 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-549c7c78-04f7-443e-9d95-9e700e151f0c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:06.868000 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-549c7c78-04f7-443e-9d95-9e700e151f0c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:06.868608 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-549c7c78-04f7-443e-9d95-9e700e151f0c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:06.914585 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9da250d7-aa22-46a5-af65-fbd6208fb5e6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:06.915578 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9da250d7-aa22-46a5-af65-fbd6208fb5e6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:06.935569 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9da250d7-aa22-46a5-af65-fbd6208fb5e6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:06.940704 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9da250d7-aa22-46a5-af65-fbd6208fb5e6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:06.942732 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9da250d7-aa22-46a5-af65-fbd6208fb5e6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:06.943792 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9da250d7-aa22-46a5-af65-fbd6208fb5e6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:07.319346 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9da250d7-aa22-46a5-af65-fbd6208fb5e6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:07.350004 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9da250d7-aa22-46a5-af65-fbd6208fb5e6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.440734 Nov 19 03:21:07.365617 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 115/224] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:06 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:07.371621 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4a945cdd-02d9-41cd-bdfb-6184ad6d0109 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:07.372344 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4a945cdd-02d9-41cd-bdfb-6184ad6d0109 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:07.384194 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-549c7c78-04f7-443e-9d95-9e700e151f0c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "POST /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535712 Nov 19 03:21:07.385803 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4a945cdd-02d9-41cd-bdfb-6184ad6d0109 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:07.386271 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4a945cdd-02d9-41cd-bdfb-6184ad6d0109 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:07.387097 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4a945cdd-02d9-41cd-bdfb-6184ad6d0109 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:07.387888 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 110/225] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:21:06 2021] POST /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:21:07.387999 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4a945cdd-02d9-41cd-bdfb-6184ad6d0109 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:07.570303 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4a945cdd-02d9-41cd-bdfb-6184ad6d0109 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:07.579291 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4a945cdd-02d9-41cd-bdfb-6184ad6d0109 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1464 microversion: 2.1 time: 0.223069 Nov 19 03:21:07.579986 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 116/226] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:07 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1464 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:07.620573 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-138a7da6-588d-42f9-8b46-8fd926e8d2e1 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:07.621178 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-138a7da6-588d-42f9-8b46-8fd926e8d2e1 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:07.633008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3670cdba-6fd2-405f-8541-0e6d1e931e21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:07.634108 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-138a7da6-588d-42f9-8b46-8fd926e8d2e1 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:07.634600 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-138a7da6-588d-42f9-8b46-8fd926e8d2e1 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:07.635667 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3670cdba-6fd2-405f-8541-0e6d1e931e21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:07.640018 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-138a7da6-588d-42f9-8b46-8fd926e8d2e1 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:07.640957 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-138a7da6-588d-42f9-8b46-8fd926e8d2e1 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:07.643461 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3670cdba-6fd2-405f-8541-0e6d1e931e21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:07.644077 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3670cdba-6fd2-405f-8541-0e6d1e931e21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:07.646177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3670cdba-6fd2-405f-8541-0e6d1e931e21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:07.646970 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3670cdba-6fd2-405f-8541-0e6d1e931e21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:07.675987 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-138a7da6-588d-42f9-8b46-8fd926e8d2e1 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Going to try to terminate instance {{(pid=116066) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:21:07.781871 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3670cdba-6fd2-405f-8541-0e6d1e931e21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 14 microversion: 2.20 time: 0.151464 Nov 19 03:21:07.783386 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 117/227] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:07 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:07.795088 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-138a7da6-588d-42f9-8b46-8fd926e8d2e1 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 204 len: 0 microversion: 2.1 time: 0.179283 Nov 19 03:21:07.796145 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 111/228] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:21:07 2021] DELETE /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:21:07.828235 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a93913d1-b97a-4301-8cae-3348ef4cde2d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:07.828826 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a93913d1-b97a-4301-8cae-3348ef4cde2d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:07.837196 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a93913d1-b97a-4301-8cae-3348ef4cde2d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:07.837645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a93913d1-b97a-4301-8cae-3348ef4cde2d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:07.838431 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a93913d1-b97a-4301-8cae-3348ef4cde2d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:07.838907 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a93913d1-b97a-4301-8cae-3348ef4cde2d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:08.003945 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a93913d1-b97a-4301-8cae-3348ef4cde2d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:08.013040 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a93913d1-b97a-4301-8cae-3348ef4cde2d tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1470 microversion: 2.1 time: 0.212355 Nov 19 03:21:08.023302 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 118/229] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:07 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1470 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:08.373614 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d1f89d8a-3bce-408c-8a17-be5d324c2dfb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:08.374881 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d1f89d8a-3bce-408c-8a17-be5d324c2dfb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:08.382562 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d1f89d8a-3bce-408c-8a17-be5d324c2dfb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:08.383040 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d1f89d8a-3bce-408c-8a17-be5d324c2dfb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:08.383835 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d1f89d8a-3bce-408c-8a17-be5d324c2dfb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:08.384252 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d1f89d8a-3bce-408c-8a17-be5d324c2dfb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:08.544234 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d1f89d8a-3bce-408c-8a17-be5d324c2dfb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:08.552254 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d1f89d8a-3bce-408c-8a17-be5d324c2dfb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.182795 Nov 19 03:21:08.552823 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 112/230] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:08 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:08.793665 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6723ed87-f9cb-4c88-9e55-8afde414a54c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:08.794737 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6723ed87-f9cb-4c88-9e55-8afde414a54c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:08.801417 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6723ed87-f9cb-4c88-9e55-8afde414a54c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:08.801872 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6723ed87-f9cb-4c88-9e55-8afde414a54c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:08.802726 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6723ed87-f9cb-4c88-9e55-8afde414a54c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:08.803219 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6723ed87-f9cb-4c88-9e55-8afde414a54c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:08.902904 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6723ed87-f9cb-4c88-9e55-8afde414a54c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 14 microversion: 2.20 time: 0.112600 Nov 19 03:21:08.904895 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 119/231] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:08 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:09.032136 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6fecdc11-0879-4ba8-8543-b98ecacb010e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:09.033049 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6fecdc11-0879-4ba8-8543-b98ecacb010e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:09.040772 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6fecdc11-0879-4ba8-8543-b98ecacb010e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:09.041359 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6fecdc11-0879-4ba8-8543-b98ecacb010e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:09.042221 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6fecdc11-0879-4ba8-8543-b98ecacb010e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:09.042891 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6fecdc11-0879-4ba8-8543-b98ecacb010e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:09.203847 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-6fecdc11-0879-4ba8-8543-b98ecacb010e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:09.213379 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6fecdc11-0879-4ba8-8543-b98ecacb010e tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1470 microversion: 2.1 time: 0.186072 Nov 19 03:21:09.214392 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 113/232] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:09 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:09.569676 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8e090b54-f45f-4985-b229-a5f31edf5194 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:09.570364 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8e090b54-f45f-4985-b229-a5f31edf5194 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:09.577785 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8e090b54-f45f-4985-b229-a5f31edf5194 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:09.578447 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8e090b54-f45f-4985-b229-a5f31edf5194 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:09.579401 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8e090b54-f45f-4985-b229-a5f31edf5194 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:09.579980 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8e090b54-f45f-4985-b229-a5f31edf5194 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:09.723419 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8e090b54-f45f-4985-b229-a5f31edf5194 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:09.731182 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8e090b54-f45f-4985-b229-a5f31edf5194 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.165425 Nov 19 03:21:09.731838 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 120/233] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:09 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:09.914132 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4e5066c7-71d4-4b1a-be80-c02b3183adce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:09.915131 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4e5066c7-71d4-4b1a-be80-c02b3183adce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:09.922416 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e5066c7-71d4-4b1a-be80-c02b3183adce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:09.922962 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e5066c7-71d4-4b1a-be80-c02b3183adce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:09.923825 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e5066c7-71d4-4b1a-be80-c02b3183adce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:09.924264 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e5066c7-71d4-4b1a-be80-c02b3183adce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:10.123558 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4e5066c7-71d4-4b1a-be80-c02b3183adce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 14 microversion: 2.20 time: 0.213568 Nov 19 03:21:10.124942 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 114/234] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:09 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 14 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:10.233507 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-78910812-af69-4c83-a847-47c438fed155 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:10.234170 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-78910812-af69-4c83-a847-47c438fed155 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:10.245105 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-78910812-af69-4c83-a847-47c438fed155 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:10.245596 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-78910812-af69-4c83-a847-47c438fed155 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:10.246586 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-78910812-af69-4c83-a847-47c438fed155 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:10.247016 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-78910812-af69-4c83-a847-47c438fed155 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:10.509523 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-78910812-af69-4c83-a847-47c438fed155 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:10.519093 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-78910812-af69-4c83-a847-47c438fed155 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1470 microversion: 2.1 time: 0.289847 Nov 19 03:21:10.519711 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 121/235] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:10 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1470 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:10.749171 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4625ebf8-88ba-44e2-a84b-29b38f0f56d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:10.750055 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4625ebf8-88ba-44e2-a84b-29b38f0f56d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:10.757024 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4625ebf8-88ba-44e2-a84b-29b38f0f56d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:10.757919 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4625ebf8-88ba-44e2-a84b-29b38f0f56d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:10.759400 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4625ebf8-88ba-44e2-a84b-29b38f0f56d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:10.759844 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4625ebf8-88ba-44e2-a84b-29b38f0f56d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:10.980308 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-4625ebf8-88ba-44e2-a84b-29b38f0f56d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:10.991711 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4625ebf8-88ba-44e2-a84b-29b38f0f56d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.247273 Nov 19 03:21:10.992454 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 115/236] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:10 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:11.072318 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-63e0c77b-0b84-4d90-acef-8dc35d6a4caf req-4eec6447-aa84-470f-9ba9-3ce08e02c7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d668ca76-7d13-479a-81de-3fb38e242812", "name": "network-vif-deleted", "tag": "314c6c6f-8af0-4b27-9cbd-6de5ea3bc3f6"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:11.074243 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:21:11.074243 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:21:11.095646 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-63e0c77b-0b84-4d90-acef-8dc35d6a4caf req-4eec6447-aa84-470f-9ba9-3ce08e02c7f9 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:11.103892 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-63e0c77b-0b84-4d90-acef-8dc35d6a4caf req-4eec6447-aa84-470f-9ba9-3ce08e02c7f9 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:11.119084 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-63e0c77b-0b84-4d90-acef-8dc35d6a4caf req-4eec6447-aa84-470f-9ba9-3ce08e02c7f9 service nova] Creating event network-vif-deleted:314c6c6f-8af0-4b27-9cbd-6de5ea3bc3f6 for instance d668ca76-7d13-479a-81de-3fb38e242812 on hv-cinder-81803 Nov 19 03:21:11.125609 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-63e0c77b-0b84-4d90-acef-8dc35d6a4caf req-4eec6447-aa84-470f-9ba9-3ce08e02c7f9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056967 Nov 19 03:21:11.127605 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 122/237] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:21:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:21:11.135376 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6e00729a-5e1b-4d8c-83b6-2ea83e7a6de9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:11.136472 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6e00729a-5e1b-4d8c-83b6-2ea83e7a6de9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:11.143491 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e00729a-5e1b-4d8c-83b6-2ea83e7a6de9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:11.144121 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e00729a-5e1b-4d8c-83b6-2ea83e7a6de9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:11.145036 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e00729a-5e1b-4d8c-83b6-2ea83e7a6de9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:11.145553 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e00729a-5e1b-4d8c-83b6-2ea83e7a6de9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:11.541394 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e000b569-5f2e-4d9f-aae3-0756a328b2ff tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:11.542224 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e000b569-5f2e-4d9f-aae3-0756a328b2ff tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:11.549625 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e000b569-5f2e-4d9f-aae3-0756a328b2ff tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:11.550166 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e000b569-5f2e-4d9f-aae3-0756a328b2ff tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:11.551100 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e000b569-5f2e-4d9f-aae3-0756a328b2ff tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:11.551537 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e000b569-5f2e-4d9f-aae3-0756a328b2ff tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:11.614406 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e000b569-5f2e-4d9f-aae3-0756a328b2ff tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:11.623498 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e000b569-5f2e-4d9f-aae3-0756a328b2ff tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1428 microversion: 2.1 time: 0.086026 Nov 19 03:21:11.625272 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 123/238] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:11 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:12.009524 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-22404c1b-2ae3-4a8b-9b5b-3886a719255b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:12.010126 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-22404c1b-2ae3-4a8b-9b5b-3886a719255b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:12.017589 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-22404c1b-2ae3-4a8b-9b5b-3886a719255b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:12.018033 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-22404c1b-2ae3-4a8b-9b5b-3886a719255b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:12.018840 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-22404c1b-2ae3-4a8b-9b5b-3886a719255b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:12.019265 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-22404c1b-2ae3-4a8b-9b5b-3886a719255b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:12.160641 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-22404c1b-2ae3-4a8b-9b5b-3886a719255b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:12.168632 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-22404c1b-2ae3-4a8b-9b5b-3886a719255b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.163527 Nov 19 03:21:12.170995 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 124/239] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:12 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:12.642229 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a952f64b-d3e1-4aee-9934-d9d7d3780d45 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:12.643021 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a952f64b-d3e1-4aee-9934-d9d7d3780d45 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:12.649903 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a952f64b-d3e1-4aee-9934-d9d7d3780d45 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:12.650351 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a952f64b-d3e1-4aee-9934-d9d7d3780d45 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:12.651222 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a952f64b-d3e1-4aee-9934-d9d7d3780d45 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:12.651864 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a952f64b-d3e1-4aee-9934-d9d7d3780d45 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:12.713841 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a952f64b-d3e1-4aee-9934-d9d7d3780d45 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:12.721929 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a952f64b-d3e1-4aee-9934-d9d7d3780d45 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1299 microversion: 2.1 time: 0.083784 Nov 19 03:21:12.722872 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 125/240] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:12 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:13.185986 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-571fd1ff-3ba0-4bd7-84ce-9023b92cd3c0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:13.187333 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-571fd1ff-3ba0-4bd7-84ce-9023b92cd3c0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:13.193757 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-571fd1ff-3ba0-4bd7-84ce-9023b92cd3c0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:13.194206 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-571fd1ff-3ba0-4bd7-84ce-9023b92cd3c0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:13.195014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-571fd1ff-3ba0-4bd7-84ce-9023b92cd3c0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:13.195477 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-571fd1ff-3ba0-4bd7-84ce-9023b92cd3c0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:13.349373 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-571fd1ff-3ba0-4bd7-84ce-9023b92cd3c0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:13.356970 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-571fd1ff-3ba0-4bd7-84ce-9023b92cd3c0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.174603 Nov 19 03:21:13.357534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 126/241] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:13 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:13.739808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8814d1bc-56fd-4a21-84b9-af26f72a8efe tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:13.741233 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8814d1bc-56fd-4a21-84b9-af26f72a8efe tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:13.748657 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8814d1bc-56fd-4a21-84b9-af26f72a8efe tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:13.749510 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8814d1bc-56fd-4a21-84b9-af26f72a8efe tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:13.750909 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8814d1bc-56fd-4a21-84b9-af26f72a8efe tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:13.751635 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8814d1bc-56fd-4a21-84b9-af26f72a8efe tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:13.833191 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8814d1bc-56fd-4a21-84b9-af26f72a8efe tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:13.846439 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8814d1bc-56fd-4a21-84b9-af26f72a8efe tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1299 microversion: 2.1 time: 0.109663 Nov 19 03:21:13.847074 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 127/242] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:13 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:14.372943 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-eeb3adf8-be9b-489c-8476-9ff3dda9feb0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:14.373569 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-eeb3adf8-be9b-489c-8476-9ff3dda9feb0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:14.381089 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eeb3adf8-be9b-489c-8476-9ff3dda9feb0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:14.381537 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eeb3adf8-be9b-489c-8476-9ff3dda9feb0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:14.382316 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eeb3adf8-be9b-489c-8476-9ff3dda9feb0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:14.382776 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eeb3adf8-be9b-489c-8476-9ff3dda9feb0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:14.514822 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-eeb3adf8-be9b-489c-8476-9ff3dda9feb0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:14.522305 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-eeb3adf8-be9b-489c-8476-9ff3dda9feb0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.152983 Nov 19 03:21:14.523176 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 128/243] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:14 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:14.863452 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4120e5c5-3bb8-4122-91e4-8b7161061b77 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:14.864693 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4120e5c5-3bb8-4122-91e4-8b7161061b77 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:14.870428 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4120e5c5-3bb8-4122-91e4-8b7161061b77 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:14.870904 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4120e5c5-3bb8-4122-91e4-8b7161061b77 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:14.871685 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4120e5c5-3bb8-4122-91e4-8b7161061b77 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:14.872118 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4120e5c5-3bb8-4122-91e4-8b7161061b77 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:14.932107 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4120e5c5-3bb8-4122-91e4-8b7161061b77 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:14.940351 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4120e5c5-3bb8-4122-91e4-8b7161061b77 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1299 microversion: 2.1 time: 0.080421 Nov 19 03:21:14.940923 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 129/244] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:14 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1299 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:15.442181 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6e00729a-5e1b-4d8c-83b6-2ea83e7a6de9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 14 microversion: 2.20 time: 4.309715 Nov 19 03:21:15.443643 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 116/245] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:11 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 14 bytes in 4313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:15.538927 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3f48f0d3-9143-4f41-beda-f9c79ba0434a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:15.539524 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3f48f0d3-9143-4f41-beda-f9c79ba0434a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:15.547195 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3f48f0d3-9143-4f41-beda-f9c79ba0434a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:15.548096 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3f48f0d3-9143-4f41-beda-f9c79ba0434a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:15.549068 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3f48f0d3-9143-4f41-beda-f9c79ba0434a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:15.552383 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3f48f0d3-9143-4f41-beda-f9c79ba0434a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:15.692660 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3f48f0d3-9143-4f41-beda-f9c79ba0434a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:15.700162 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3f48f0d3-9143-4f41-beda-f9c79ba0434a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.164894 Nov 19 03:21:15.700724 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 130/246] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:15 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:15.958047 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-51c13c08-926e-4df8-9ae2-5da0f91ebf79 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:15.958774 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-51c13c08-926e-4df8-9ae2-5da0f91ebf79 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:15.965580 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51c13c08-926e-4df8-9ae2-5da0f91ebf79 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:15.966025 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51c13c08-926e-4df8-9ae2-5da0f91ebf79 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:15.966827 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51c13c08-926e-4df8-9ae2-5da0f91ebf79 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:15.967261 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51c13c08-926e-4df8-9ae2-5da0f91ebf79 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:16.004544 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51c13c08-926e-4df8-9ae2-5da0f91ebf79 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:16.005093 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51c13c08-926e-4df8-9ae2-5da0f91ebf79 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:16.005663 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.objects.instance [None req-51c13c08-926e-4df8-9ae2-5da0f91ebf79 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lazy-loading 'fault' on Instance uuid d668ca76-7d13-479a-81de-3fb38e242812 {{(pid=116066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:21:16.052944 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-51c13c08-926e-4df8-9ae2-5da0f91ebf79 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff0cf421da24952967aff15f565db46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb6b42dcbee4a2e816a4831adf88bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:16.061143 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-51c13c08-926e-4df8-9ae2-5da0f91ebf79 tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 200 len: 1304 microversion: 2.1 time: 0.107108 Nov 19 03:21:16.061910 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 117/247] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:15 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:16.454168 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7693dabe-cf20-489d-bbe5-80065ea298bc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:16.455128 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7693dabe-cf20-489d-bbe5-80065ea298bc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:16.460802 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7693dabe-cf20-489d-bbe5-80065ea298bc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:16.461244 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7693dabe-cf20-489d-bbe5-80065ea298bc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:16.462015 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7693dabe-cf20-489d-bbe5-80065ea298bc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:16.462445 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7693dabe-cf20-489d-bbe5-80065ea298bc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:16.554930 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7693dabe-cf20-489d-bbe5-80065ea298bc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 14 microversion: 2.20 time: 0.105114 Nov 19 03:21:16.558029 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 131/248] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:16 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:16.718346 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7a0621ec-42c5-42d1-82f4-8e6adcfb6eae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:16.719278 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7a0621ec-42c5-42d1-82f4-8e6adcfb6eae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:16.746201 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7a0621ec-42c5-42d1-82f4-8e6adcfb6eae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:16.747573 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7a0621ec-42c5-42d1-82f4-8e6adcfb6eae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:16.750529 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7a0621ec-42c5-42d1-82f4-8e6adcfb6eae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:16.751043 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7a0621ec-42c5-42d1-82f4-8e6adcfb6eae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:16.901865 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-7a0621ec-42c5-42d1-82f4-8e6adcfb6eae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:16.910028 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7a0621ec-42c5-42d1-82f4-8e6adcfb6eae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.196786 Nov 19 03:21:16.910962 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 118/249] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:16 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:17.080480 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ac077ab9-5b84-4ba5-ad04-613d52d7807c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:17.081254 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ac077ab9-5b84-4ba5-ad04-613d52d7807c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] [instance: d668ca76-7d13-479a-81de-3fb38e242812] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:17.089423 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ac077ab9-5b84-4ba5-ad04-613d52d7807c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:17.089875 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ac077ab9-5b84-4ba5-ad04-613d52d7807c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:17.090788 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ac077ab9-5b84-4ba5-ad04-613d52d7807c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:17.091229 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ac077ab9-5b84-4ba5-ad04-613d52d7807c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:17.107681 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-ac077ab9-5b84-4ba5-ad04-613d52d7807c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] HTTP exception thrown: Instance d668ca76-7d13-479a-81de-3fb38e242812 could not be found. Nov 19 03:21:17.108452 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ac077ab9-5b84-4ba5-ad04-613d52d7807c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] Returning 404 to user: Instance d668ca76-7d13-479a-81de-3fb38e242812 could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:21:17.109288 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ac077ab9-5b84-4ba5-ad04-613d52d7807c tempest-VolumesNegativeTest-2135351506 tempest-VolumesNegativeTest-2135351506-project] 10.222.0.47 "GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812" status: 404 len: 111 microversion: 2.1 time: 0.034688 Nov 19 03:21:17.110012 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 132/250] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:17 2021] GET /compute/v2.1/servers/d668ca76-7d13-479a-81de-3fb38e242812 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:21:17.566758 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f1c80d7e-53db-48f3-a730-ee70106b06dc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:17.567758 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f1c80d7e-53db-48f3-a730-ee70106b06dc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:17.574434 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f1c80d7e-53db-48f3-a730-ee70106b06dc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:17.575085 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f1c80d7e-53db-48f3-a730-ee70106b06dc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:17.576016 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f1c80d7e-53db-48f3-a730-ee70106b06dc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:17.576596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f1c80d7e-53db-48f3-a730-ee70106b06dc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:17.928375 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c63b08d2-0123-42ea-9307-abcb70290447 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:17.928976 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c63b08d2-0123-42ea-9307-abcb70290447 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:17.937067 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c63b08d2-0123-42ea-9307-abcb70290447 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:17.937517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c63b08d2-0123-42ea-9307-abcb70290447 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:17.938296 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c63b08d2-0123-42ea-9307-abcb70290447 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:17.938750 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c63b08d2-0123-42ea-9307-abcb70290447 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:18.111784 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c63b08d2-0123-42ea-9307-abcb70290447 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:18.121328 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c63b08d2-0123-42ea-9307-abcb70290447 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.195297 Nov 19 03:21:18.122674 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 133/251] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:17 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:19.137530 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1d7986e9-4714-4341-b884-3cbbb127fd99 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:19.138760 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1d7986e9-4714-4341-b884-3cbbb127fd99 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:19.146024 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1d7986e9-4714-4341-b884-3cbbb127fd99 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:19.146563 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1d7986e9-4714-4341-b884-3cbbb127fd99 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:19.147269 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1d7986e9-4714-4341-b884-3cbbb127fd99 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:19.147704 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1d7986e9-4714-4341-b884-3cbbb127fd99 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:19.284675 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1d7986e9-4714-4341-b884-3cbbb127fd99 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:19.291995 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1d7986e9-4714-4341-b884-3cbbb127fd99 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.158287 Nov 19 03:21:19.296802 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 134/252] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:19 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:20.308739 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-01aa284b-a426-4ee0-9a6a-2ababf8fc31b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:20.309327 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-01aa284b-a426-4ee0-9a6a-2ababf8fc31b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:20.316570 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-01aa284b-a426-4ee0-9a6a-2ababf8fc31b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:20.317006 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-01aa284b-a426-4ee0-9a6a-2ababf8fc31b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:20.317764 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-01aa284b-a426-4ee0-9a6a-2ababf8fc31b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:20.318193 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-01aa284b-a426-4ee0-9a6a-2ababf8fc31b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:20.447368 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-01aa284b-a426-4ee0-9a6a-2ababf8fc31b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:20.454902 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-01aa284b-a426-4ee0-9a6a-2ababf8fc31b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.149826 Nov 19 03:21:20.455459 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 135/253] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:20 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:21.471293 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8ea4afce-0ad1-4a86-b557-7de1a567e694 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:21.471929 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8ea4afce-0ad1-4a86-b557-7de1a567e694 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:21.478417 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8ea4afce-0ad1-4a86-b557-7de1a567e694 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:21.478888 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8ea4afce-0ad1-4a86-b557-7de1a567e694 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:21.479679 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8ea4afce-0ad1-4a86-b557-7de1a567e694 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:21.480105 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8ea4afce-0ad1-4a86-b557-7de1a567e694 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:21.608382 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8ea4afce-0ad1-4a86-b557-7de1a567e694 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:21.615568 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8ea4afce-0ad1-4a86-b557-7de1a567e694 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.147845 Nov 19 03:21:21.616124 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 136/254] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:21 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:22.478029 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f1c80d7e-53db-48f3-a730-ee70106b06dc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 18252 microversion: 2.20 time: 4.915456 Nov 19 03:21:22.478722 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 119/255] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:17 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 18252 bytes in 4918 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:22.632986 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-cc44cb9a-c001-476e-8c93-058c01bbeff0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:22.633585 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-cc44cb9a-c001-476e-8c93-058c01bbeff0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:22.640249 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc44cb9a-c001-476e-8c93-058c01bbeff0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:22.640688 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc44cb9a-c001-476e-8c93-058c01bbeff0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:22.641469 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc44cb9a-c001-476e-8c93-058c01bbeff0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:22.641900 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc44cb9a-c001-476e-8c93-058c01bbeff0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:22.771717 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-cc44cb9a-c001-476e-8c93-058c01bbeff0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:22.779206 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-cc44cb9a-c001-476e-8c93-058c01bbeff0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.150015 Nov 19 03:21:22.779766 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 137/256] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:22 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:23.491980 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-85edb179-a535-492c-83a3-31f9a9bef72e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:23.493673 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-85edb179-a535-492c-83a3-31f9a9bef72e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:23.502214 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-85edb179-a535-492c-83a3-31f9a9bef72e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:23.502691 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-85edb179-a535-492c-83a3-31f9a9bef72e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:23.503471 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-85edb179-a535-492c-83a3-31f9a9bef72e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:23.503902 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-85edb179-a535-492c-83a3-31f9a9bef72e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:23.624898 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-85edb179-a535-492c-83a3-31f9a9bef72e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 19342 microversion: 2.20 time: 0.137797 Nov 19 03:21:23.628658 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 120/257] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:23 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 19342 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:23.796997 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-52758b5d-7b07-4875-939d-fcc0c4b8edf6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:23.797625 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-52758b5d-7b07-4875-939d-fcc0c4b8edf6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:23.803834 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-52758b5d-7b07-4875-939d-fcc0c4b8edf6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:23.804277 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-52758b5d-7b07-4875-939d-fcc0c4b8edf6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:23.805044 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-52758b5d-7b07-4875-939d-fcc0c4b8edf6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:23.805505 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-52758b5d-7b07-4875-939d-fcc0c4b8edf6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:23.935781 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-52758b5d-7b07-4875-939d-fcc0c4b8edf6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:23.943624 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-52758b5d-7b07-4875-939d-fcc0c4b8edf6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.150799 Nov 19 03:21:23.944191 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 138/258] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:23 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:24.394726 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7fdd8efa-82e5-40ed-ad5d-f607553cd1b6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:24.395296 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7fdd8efa-82e5-40ed-ad5d-f607553cd1b6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:24.402233 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7fdd8efa-82e5-40ed-ad5d-f607553cd1b6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:24.402703 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7fdd8efa-82e5-40ed-ad5d-f607553cd1b6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:24.403495 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7fdd8efa-82e5-40ed-ad5d-f607553cd1b6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:24.403922 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7fdd8efa-82e5-40ed-ad5d-f607553cd1b6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:24.430301 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7fdd8efa-82e5-40ed-ad5d-f607553cd1b6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Going to try to terminate instance {{(pid=116066) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:21:24.507104 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7fdd8efa-82e5-40ed-ad5d-f607553cd1b6 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 204 len: 0 microversion: 2.1 time: 0.115963 Nov 19 03:21:24.507777 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 121/259] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:21:24 2021] DELETE /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:21:24.516149 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9fa03a79-d8a4-4ffc-8aaa-ce8e11cdbfe1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:24.516751 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9fa03a79-d8a4-4ffc-8aaa-ce8e11cdbfe1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:24.522435 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9fa03a79-d8a4-4ffc-8aaa-ce8e11cdbfe1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:24.523180 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9fa03a79-d8a4-4ffc-8aaa-ce8e11cdbfe1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:24.523947 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9fa03a79-d8a4-4ffc-8aaa-ce8e11cdbfe1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:24.524382 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9fa03a79-d8a4-4ffc-8aaa-ce8e11cdbfe1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:24.636694 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f3c8d377-c95b-4bda-8e42-8cc7f637647b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:24.637817 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f3c8d377-c95b-4bda-8e42-8cc7f637647b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:24.644949 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f3c8d377-c95b-4bda-8e42-8cc7f637647b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:24.645442 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f3c8d377-c95b-4bda-8e42-8cc7f637647b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:24.646256 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f3c8d377-c95b-4bda-8e42-8cc7f637647b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:24.646724 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f3c8d377-c95b-4bda-8e42-8cc7f637647b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:24.658153 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9fa03a79-d8a4-4ffc-8aaa-ce8e11cdbfe1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:24.667252 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9fa03a79-d8a4-4ffc-8aaa-ce8e11cdbfe1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1552 microversion: 2.1 time: 0.155190 Nov 19 03:21:24.667833 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 139/260] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:24 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:24.808839 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f3c8d377-c95b-4bda-8e42-8cc7f637647b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 21282 microversion: 2.20 time: 0.176067 Nov 19 03:21:24.809621 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 122/261] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:24 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 21282 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:24.960001 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1293acd4-984b-412b-bc53-6b9dc6a48025 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:24.960779 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1293acd4-984b-412b-bc53-6b9dc6a48025 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:24.967135 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1293acd4-984b-412b-bc53-6b9dc6a48025 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:24.968369 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1293acd4-984b-412b-bc53-6b9dc6a48025 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:24.969334 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1293acd4-984b-412b-bc53-6b9dc6a48025 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:24.969848 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1293acd4-984b-412b-bc53-6b9dc6a48025 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:25.111008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1293acd4-984b-412b-bc53-6b9dc6a48025 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:25.118145 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1293acd4-984b-412b-bc53-6b9dc6a48025 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.161672 Nov 19 03:21:25.118660 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 140/262] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:24 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:25.685708 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2cb9aa33-0f9f-4d37-b661-6e154852f040 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:25.687446 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2cb9aa33-0f9f-4d37-b661-6e154852f040 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:25.695422 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2cb9aa33-0f9f-4d37-b661-6e154852f040 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:25.695942 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2cb9aa33-0f9f-4d37-b661-6e154852f040 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:25.696758 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2cb9aa33-0f9f-4d37-b661-6e154852f040 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:25.697252 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2cb9aa33-0f9f-4d37-b661-6e154852f040 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:25.846930 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2cb9aa33-0f9f-4d37-b661-6e154852f040 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:25.854958 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2cb9aa33-0f9f-4d37-b661-6e154852f040 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1552 microversion: 2.1 time: 0.173418 Nov 19 03:21:25.855612 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 123/263] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:25 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:25.860060 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6621e24d-e673-4eda-9f4b-4a28602a9394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:25.861086 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6621e24d-e673-4eda-9f4b-4a28602a9394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:25.867379 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6621e24d-e673-4eda-9f4b-4a28602a9394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:25.867820 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6621e24d-e673-4eda-9f4b-4a28602a9394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:25.868591 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6621e24d-e673-4eda-9f4b-4a28602a9394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:25.869045 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6621e24d-e673-4eda-9f4b-4a28602a9394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:26.002895 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6621e24d-e673-4eda-9f4b-4a28602a9394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 22589 microversion: 2.20 time: 0.147284 Nov 19 03:21:26.003528 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 141/264] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:25 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 22589 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:26.135519 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-23b23a33-7a0c-4ac0-92f4-6ba979a82263 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:26.136444 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-23b23a33-7a0c-4ac0-92f4-6ba979a82263 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:26.146685 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-23b23a33-7a0c-4ac0-92f4-6ba979a82263 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:26.147547 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-23b23a33-7a0c-4ac0-92f4-6ba979a82263 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:26.148827 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-23b23a33-7a0c-4ac0-92f4-6ba979a82263 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:26.149551 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-23b23a33-7a0c-4ac0-92f4-6ba979a82263 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:26.313876 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-23b23a33-7a0c-4ac0-92f4-6ba979a82263 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:26.328618 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-23b23a33-7a0c-4ac0-92f4-6ba979a82263 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.190820 Nov 19 03:21:26.328618 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 124/265] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:26 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:26.873855 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-72bc3ca0-2d7a-40b3-98f8-c4c208d2a46e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:26.874763 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-72bc3ca0-2d7a-40b3-98f8-c4c208d2a46e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:26.881724 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-72bc3ca0-2d7a-40b3-98f8-c4c208d2a46e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:26.882188 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-72bc3ca0-2d7a-40b3-98f8-c4c208d2a46e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:26.882972 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-72bc3ca0-2d7a-40b3-98f8-c4c208d2a46e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:26.883407 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-72bc3ca0-2d7a-40b3-98f8-c4c208d2a46e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:27.014656 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2a08ce62-8fe5-4c72-8856-162b830533d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:27.015909 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2a08ce62-8fe5-4c72-8856-162b830533d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:27.022303 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2a08ce62-8fe5-4c72-8856-162b830533d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:27.022862 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2a08ce62-8fe5-4c72-8856-162b830533d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:27.023962 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2a08ce62-8fe5-4c72-8856-162b830533d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:27.024395 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2a08ce62-8fe5-4c72-8856-162b830533d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:27.036114 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-72bc3ca0-2d7a-40b3-98f8-c4c208d2a46e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:27.044026 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-72bc3ca0-2d7a-40b3-98f8-c4c208d2a46e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1552 microversion: 2.1 time: 0.174507 Nov 19 03:21:27.044594 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 142/266] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:26 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:27.217067 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2a08ce62-8fe5-4c72-8856-162b830533d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 23559 microversion: 2.20 time: 0.206106 Nov 19 03:21:27.218336 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 125/267] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:27 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 23559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:21:27.340029 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-df1c0b7f-034e-4c61-8650-06f136c26b2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:27.340632 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-df1c0b7f-034e-4c61-8650-06f136c26b2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:27.347377 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-df1c0b7f-034e-4c61-8650-06f136c26b2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:27.347821 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-df1c0b7f-034e-4c61-8650-06f136c26b2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:27.348586 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-df1c0b7f-034e-4c61-8650-06f136c26b2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:27.349016 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-df1c0b7f-034e-4c61-8650-06f136c26b2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:27.484804 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-df1c0b7f-034e-4c61-8650-06f136c26b2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:27.491968 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-df1c0b7f-034e-4c61-8650-06f136c26b2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.155520 Nov 19 03:21:27.492531 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 143/268] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:27 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:28.064088 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9dc2d6a7-8b8b-48c5-a8d1-545ecef552d3 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:28.064834 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9dc2d6a7-8b8b-48c5-a8d1-545ecef552d3 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:28.073998 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9dc2d6a7-8b8b-48c5-a8d1-545ecef552d3 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:28.074873 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9dc2d6a7-8b8b-48c5-a8d1-545ecef552d3 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:28.075839 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9dc2d6a7-8b8b-48c5-a8d1-545ecef552d3 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:28.076623 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9dc2d6a7-8b8b-48c5-a8d1-545ecef552d3 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:28.130266 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-cb861f9e-54f7-46dd-8948-6a3e9ddcb27d req-3b5561c4-cf95-4f6b-a511-a6bf84ac139e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ce8291-c6df-4afe-a958-5b8ef4c447fd", "name": "network-vif-deleted", "tag": "564d4434-0349-4ca0-a3f4-f36410053f5a"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:28.133235 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:21:28.133235 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:21:28.143517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-cb861f9e-54f7-46dd-8948-6a3e9ddcb27d req-3b5561c4-cf95-4f6b-a511-a6bf84ac139e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:28.144123 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-cb861f9e-54f7-46dd-8948-6a3e9ddcb27d req-3b5561c4-cf95-4f6b-a511-a6bf84ac139e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:28.170251 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-cb861f9e-54f7-46dd-8948-6a3e9ddcb27d req-3b5561c4-cf95-4f6b-a511-a6bf84ac139e service nova] Creating event network-vif-deleted:564d4434-0349-4ca0-a3f4-f36410053f5a for instance c9ce8291-c6df-4afe-a958-5b8ef4c447fd on hv-cinder-81803 Nov 19 03:21:28.178710 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-cb861f9e-54f7-46dd-8948-6a3e9ddcb27d req-3b5561c4-cf95-4f6b-a511-a6bf84ac139e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055056 Nov 19 03:21:28.180248 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 144/269] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:21:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:21:28.199358 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-9dc2d6a7-8b8b-48c5-a8d1-545ecef552d3 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:28.207885 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9dc2d6a7-8b8b-48c5-a8d1-545ecef552d3 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1510 microversion: 2.1 time: 0.149881 Nov 19 03:21:28.208488 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 126/270] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:28 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:28.230342 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7c8a29bb-354c-43a1-914b-c85d30c8ec97 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:28.231387 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7c8a29bb-354c-43a1-914b-c85d30c8ec97 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:28.241132 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c8a29bb-354c-43a1-914b-c85d30c8ec97 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:28.241703 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c8a29bb-354c-43a1-914b-c85d30c8ec97 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:28.242591 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c8a29bb-354c-43a1-914b-c85d30c8ec97 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:28.243100 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c8a29bb-354c-43a1-914b-c85d30c8ec97 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:28.508919 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-98abdc1b-d787-4663-9b79-c05545d00e78 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:28.509527 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-98abdc1b-d787-4663-9b79-c05545d00e78 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:28.516326 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98abdc1b-d787-4663-9b79-c05545d00e78 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:28.516775 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98abdc1b-d787-4663-9b79-c05545d00e78 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:28.517547 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98abdc1b-d787-4663-9b79-c05545d00e78 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:28.517978 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98abdc1b-d787-4663-9b79-c05545d00e78 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:28.723242 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-98abdc1b-d787-4663-9b79-c05545d00e78 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:28.735781 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-98abdc1b-d787-4663-9b79-c05545d00e78 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.230143 Nov 19 03:21:28.736839 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 127/271] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:28 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:28.773315 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7c8a29bb-354c-43a1-914b-c85d30c8ec97 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 24423 microversion: 2.20 time: 0.540351 Nov 19 03:21:28.774025 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 145/272] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:28 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 24423 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:29.225049 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-90cb2e16-7286-48b5-a065-f8f2786734a1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:29.225772 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-90cb2e16-7286-48b5-a065-f8f2786734a1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:29.235940 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-90cb2e16-7286-48b5-a065-f8f2786734a1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:29.236619 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-90cb2e16-7286-48b5-a065-f8f2786734a1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:29.238781 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-90cb2e16-7286-48b5-a065-f8f2786734a1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:29.239538 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-90cb2e16-7286-48b5-a065-f8f2786734a1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:29.307929 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-90cb2e16-7286-48b5-a065-f8f2786734a1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:29.315731 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-90cb2e16-7286-48b5-a065-f8f2786734a1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1345 microversion: 2.1 time: 0.094506 Nov 19 03:21:29.316294 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 128/273] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:29 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:29.753831 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a3ca3972-e810-4dcd-a3f6-730de3203570 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:29.754578 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a3ca3972-e810-4dcd-a3f6-730de3203570 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:29.766295 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a3ca3972-e810-4dcd-a3f6-730de3203570 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:29.766295 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a3ca3972-e810-4dcd-a3f6-730de3203570 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:29.766295 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a3ca3972-e810-4dcd-a3f6-730de3203570 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:29.766295 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a3ca3972-e810-4dcd-a3f6-730de3203570 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:29.786818 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c5e1f52f-ac97-41f4-9908-ba1ca3e48c68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:29.788357 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c5e1f52f-ac97-41f4-9908-ba1ca3e48c68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:29.794844 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c5e1f52f-ac97-41f4-9908-ba1ca3e48c68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:29.795584 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c5e1f52f-ac97-41f4-9908-ba1ca3e48c68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:29.796777 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c5e1f52f-ac97-41f4-9908-ba1ca3e48c68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:29.797288 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c5e1f52f-ac97-41f4-9908-ba1ca3e48c68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:29.916303 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a3ca3972-e810-4dcd-a3f6-730de3203570 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:29.923811 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a3ca3972-e810-4dcd-a3f6-730de3203570 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.174131 Nov 19 03:21:29.924383 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 146/274] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:29 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:30.332779 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d547b269-7f24-4523-8153-939e598f254f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:30.332779 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d547b269-7f24-4523-8153-939e598f254f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:30.339123 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d547b269-7f24-4523-8153-939e598f254f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:30.339571 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d547b269-7f24-4523-8153-939e598f254f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:30.340378 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d547b269-7f24-4523-8153-939e598f254f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:30.340813 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d547b269-7f24-4523-8153-939e598f254f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:30.401776 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d547b269-7f24-4523-8153-939e598f254f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:30.409620 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d547b269-7f24-4523-8153-939e598f254f tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1345 microversion: 2.1 time: 0.081405 Nov 19 03:21:30.410180 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 147/275] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:30 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:30.941303 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2e3d62a8-1d84-4566-9bd0-2ab222267b66 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:30.941906 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2e3d62a8-1d84-4566-9bd0-2ab222267b66 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:30.948552 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2e3d62a8-1d84-4566-9bd0-2ab222267b66 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:30.949009 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2e3d62a8-1d84-4566-9bd0-2ab222267b66 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:30.949921 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2e3d62a8-1d84-4566-9bd0-2ab222267b66 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:30.950356 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2e3d62a8-1d84-4566-9bd0-2ab222267b66 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:31.104964 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2e3d62a8-1d84-4566-9bd0-2ab222267b66 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:31.113823 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2e3d62a8-1d84-4566-9bd0-2ab222267b66 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.174726 Nov 19 03:21:31.113823 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 148/276] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:30 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:31.426291 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6eeff358-a3fa-4b5b-beaa-447023c24a38 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:31.427016 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6eeff358-a3fa-4b5b-beaa-447023c24a38 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:31.433026 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6eeff358-a3fa-4b5b-beaa-447023c24a38 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:31.433571 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6eeff358-a3fa-4b5b-beaa-447023c24a38 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:31.434352 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6eeff358-a3fa-4b5b-beaa-447023c24a38 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:31.434814 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6eeff358-a3fa-4b5b-beaa-447023c24a38 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:31.495616 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6eeff358-a3fa-4b5b-beaa-447023c24a38 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:31.504330 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6eeff358-a3fa-4b5b-beaa-447023c24a38 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1345 microversion: 2.1 time: 0.081581 Nov 19 03:21:31.504954 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 149/277] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:31 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:32.128942 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-15e43190-2863-47cb-b576-cfff69ffa08d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:32.129616 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-15e43190-2863-47cb-b576-cfff69ffa08d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:32.135321 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-15e43190-2863-47cb-b576-cfff69ffa08d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:32.135771 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-15e43190-2863-47cb-b576-cfff69ffa08d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:32.136545 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-15e43190-2863-47cb-b576-cfff69ffa08d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:32.136986 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-15e43190-2863-47cb-b576-cfff69ffa08d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:32.270348 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-15e43190-2863-47cb-b576-cfff69ffa08d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:32.277916 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-15e43190-2863-47cb-b576-cfff69ffa08d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.152668 Nov 19 03:21:32.278499 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 150/278] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:32 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:32.522788 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-af36d61b-f7d6-4c31-9a5a-ec47e48705cc tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:32.523783 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-af36d61b-f7d6-4c31-9a5a-ec47e48705cc tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:32.531085 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-af36d61b-f7d6-4c31-9a5a-ec47e48705cc tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:32.531574 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-af36d61b-f7d6-4c31-9a5a-ec47e48705cc tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:32.532355 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-af36d61b-f7d6-4c31-9a5a-ec47e48705cc tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:32.532786 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-af36d61b-f7d6-4c31-9a5a-ec47e48705cc tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:32.593832 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-af36d61b-f7d6-4c31-9a5a-ec47e48705cc tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:32.601500 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-af36d61b-f7d6-4c31-9a5a-ec47e48705cc tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1345 microversion: 2.1 time: 0.082234 Nov 19 03:21:32.602051 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 151/279] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:32 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:32.976538 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c5e1f52f-ac97-41f4-9908-ba1ca3e48c68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 27231 microversion: 2.20 time: 3.194858 Nov 19 03:21:32.978415 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 129/280] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:29 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 27231 bytes in 3198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:21:33.294904 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-bc126774-f53d-4a14-b807-2090b7c66d08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:33.296145 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-bc126774-f53d-4a14-b807-2090b7c66d08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:33.301951 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bc126774-f53d-4a14-b807-2090b7c66d08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:33.302398 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bc126774-f53d-4a14-b807-2090b7c66d08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:33.303219 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bc126774-f53d-4a14-b807-2090b7c66d08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:33.303645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bc126774-f53d-4a14-b807-2090b7c66d08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:33.440105 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-bc126774-f53d-4a14-b807-2090b7c66d08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:33.447694 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-bc126774-f53d-4a14-b807-2090b7c66d08 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.156347 Nov 19 03:21:33.448266 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 152/281] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:33 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:33.618727 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-05ec2123-d699-4b48-bdc6-3e827639f0a0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:33.619516 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-05ec2123-d699-4b48-bdc6-3e827639f0a0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:33.626805 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-05ec2123-d699-4b48-bdc6-3e827639f0a0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:33.627255 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-05ec2123-d699-4b48-bdc6-3e827639f0a0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:33.628032 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-05ec2123-d699-4b48-bdc6-3e827639f0a0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:33.628463 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-05ec2123-d699-4b48-bdc6-3e827639f0a0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:33.694074 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-05ec2123-d699-4b48-bdc6-3e827639f0a0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:33.702407 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-05ec2123-d699-4b48-bdc6-3e827639f0a0 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1345 microversion: 2.1 time: 0.087624 Nov 19 03:21:33.702999 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 130/282] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:33 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:33.987723 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5880c4a2-95e9-4e71-896f-17fc76c4aa8e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:33.988676 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5880c4a2-95e9-4e71-896f-17fc76c4aa8e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:33.994789 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5880c4a2-95e9-4e71-896f-17fc76c4aa8e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:33.995232 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5880c4a2-95e9-4e71-896f-17fc76c4aa8e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:33.995996 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5880c4a2-95e9-4e71-896f-17fc76c4aa8e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:33.996420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5880c4a2-95e9-4e71-896f-17fc76c4aa8e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:34.466357 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b370bec9-544f-4934-8a71-f3294e1acdd0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:34.467937 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b370bec9-544f-4934-8a71-f3294e1acdd0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:34.474353 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b370bec9-544f-4934-8a71-f3294e1acdd0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:34.475430 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b370bec9-544f-4934-8a71-f3294e1acdd0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:34.476393 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b370bec9-544f-4934-8a71-f3294e1acdd0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:34.476981 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b370bec9-544f-4934-8a71-f3294e1acdd0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:34.617101 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b370bec9-544f-4934-8a71-f3294e1acdd0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:34.624332 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b370bec9-544f-4934-8a71-f3294e1acdd0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.163166 Nov 19 03:21:34.624905 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 131/283] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:34 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:34.719947 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-73273f4e-d056-495b-97ea-838eca105f68 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:34.720551 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-73273f4e-d056-495b-97ea-838eca105f68 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:34.726367 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73273f4e-d056-495b-97ea-838eca105f68 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:34.726845 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73273f4e-d056-495b-97ea-838eca105f68 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:34.727611 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73273f4e-d056-495b-97ea-838eca105f68 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:34.728038 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73273f4e-d056-495b-97ea-838eca105f68 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:35.028408 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-73273f4e-d056-495b-97ea-838eca105f68 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:35.037136 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-73273f4e-d056-495b-97ea-838eca105f68 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1345 microversion: 2.1 time: 0.321481 Nov 19 03:21:35.037717 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 132/284] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:34 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1345 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:35.641354 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7bbc88c2-88e3-4e5e-80ee-93adc9d48105 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:35.641985 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7bbc88c2-88e3-4e5e-80ee-93adc9d48105 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:35.649159 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7bbc88c2-88e3-4e5e-80ee-93adc9d48105 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:35.649618 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7bbc88c2-88e3-4e5e-80ee-93adc9d48105 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:35.650396 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7bbc88c2-88e3-4e5e-80ee-93adc9d48105 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:35.650857 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7bbc88c2-88e3-4e5e-80ee-93adc9d48105 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:35.830855 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-7bbc88c2-88e3-4e5e-80ee-93adc9d48105 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:35.846459 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7bbc88c2-88e3-4e5e-80ee-93adc9d48105 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.209064 Nov 19 03:21:35.847499 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 133/285] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:35 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:36.055385 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ed5f11d4-cce4-48a9-937f-5cb29d60a75a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:36.056507 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ed5f11d4-cce4-48a9-937f-5cb29d60a75a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:36.063971 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed5f11d4-cce4-48a9-937f-5cb29d60a75a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:36.065370 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed5f11d4-cce4-48a9-937f-5cb29d60a75a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:36.066445 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed5f11d4-cce4-48a9-937f-5cb29d60a75a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:36.067427 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed5f11d4-cce4-48a9-937f-5cb29d60a75a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:36.144017 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ed5f11d4-cce4-48a9-937f-5cb29d60a75a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:36.152537 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ed5f11d4-cce4-48a9-937f-5cb29d60a75a tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1345 microversion: 2.1 time: 0.101418 Nov 19 03:21:36.153199 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 134/286] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:36 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:36.864146 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a8443b55-590b-44f8-8d15-34fbf52cd6d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:36.865951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a8443b55-590b-44f8-8d15-34fbf52cd6d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:36.873304 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a8443b55-590b-44f8-8d15-34fbf52cd6d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:36.874590 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a8443b55-590b-44f8-8d15-34fbf52cd6d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:36.875390 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a8443b55-590b-44f8-8d15-34fbf52cd6d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:36.875831 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a8443b55-590b-44f8-8d15-34fbf52cd6d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:37.032602 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a8443b55-590b-44f8-8d15-34fbf52cd6d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:37.041549 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a8443b55-590b-44f8-8d15-34fbf52cd6d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.180794 Nov 19 03:21:37.042034 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 135/287] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:36 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:37.169249 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-96ee1737-caa0-4889-901f-e7933bb4c29e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:37.170127 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-96ee1737-caa0-4889-901f-e7933bb4c29e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:37.177226 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-96ee1737-caa0-4889-901f-e7933bb4c29e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:37.177782 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-96ee1737-caa0-4889-901f-e7933bb4c29e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:37.178731 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-96ee1737-caa0-4889-901f-e7933bb4c29e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:37.179275 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-96ee1737-caa0-4889-901f-e7933bb4c29e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:37.242248 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-96ee1737-caa0-4889-901f-e7933bb4c29e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:37.252065 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-96ee1737-caa0-4889-901f-e7933bb4c29e tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1345 microversion: 2.1 time: 0.086347 Nov 19 03:21:37.261332 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 136/288] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:37 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:37.850005 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5880c4a2-95e9-4e71-896f-17fc76c4aa8e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 27813 microversion: 2.20 time: 3.865700 Nov 19 03:21:37.851194 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 153/289] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:33 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 27813 bytes in 3867 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:38.057830 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cabca798-5d71-413d-bb14-5e43f534132a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:38.058389 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-cabca798-5d71-413d-bb14-5e43f534132a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:38.065338 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cabca798-5d71-413d-bb14-5e43f534132a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:38.065780 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cabca798-5d71-413d-bb14-5e43f534132a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:38.066581 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cabca798-5d71-413d-bb14-5e43f534132a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:38.067005 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cabca798-5d71-413d-bb14-5e43f534132a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:38.196752 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-cabca798-5d71-413d-bb14-5e43f534132a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:38.204601 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cabca798-5d71-413d-bb14-5e43f534132a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.150504 Nov 19 03:21:38.205163 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 137/290] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:38 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:38.268847 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3044d799-27ed-45a4-bc3e-b5a880fcf665 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:38.269557 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3044d799-27ed-45a4-bc3e-b5a880fcf665 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:38.276624 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3044d799-27ed-45a4-bc3e-b5a880fcf665 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:38.277068 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3044d799-27ed-45a4-bc3e-b5a880fcf665 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:38.277823 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3044d799-27ed-45a4-bc3e-b5a880fcf665 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:38.278247 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3044d799-27ed-45a4-bc3e-b5a880fcf665 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:38.343459 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3044d799-27ed-45a4-bc3e-b5a880fcf665 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:38.351294 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3044d799-27ed-45a4-bc3e-b5a880fcf665 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1345 microversion: 2.1 time: 0.086823 Nov 19 03:21:38.351842 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 154/291] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:38 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:38.862286 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-26a8a5c9-d2fe-40f1-a840-962829f5e599 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:38.863144 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-26a8a5c9-d2fe-40f1-a840-962829f5e599 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:38.869162 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-26a8a5c9-d2fe-40f1-a840-962829f5e599 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:38.870038 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-26a8a5c9-d2fe-40f1-a840-962829f5e599 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:38.871209 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-26a8a5c9-d2fe-40f1-a840-962829f5e599 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:38.871684 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-26a8a5c9-d2fe-40f1-a840-962829f5e599 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:38.986200 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-26a8a5c9-d2fe-40f1-a840-962829f5e599 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 27813 microversion: 2.20 time: 0.128176 Nov 19 03:21:38.986917 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 138/292] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:38 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 27813 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:39.221593 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3606070c-f8d8-4400-9943-3287ae1f068f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:39.222196 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3606070c-f8d8-4400-9943-3287ae1f068f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:39.228376 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3606070c-f8d8-4400-9943-3287ae1f068f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:39.228818 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3606070c-f8d8-4400-9943-3287ae1f068f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:39.229610 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3606070c-f8d8-4400-9943-3287ae1f068f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:39.230040 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3606070c-f8d8-4400-9943-3287ae1f068f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:39.369151 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3606070c-f8d8-4400-9943-3287ae1f068f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:39.369879 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b0f4af84-ddfe-4708-99d5-26cbdb68ab17 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:39.371241 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b0f4af84-ddfe-4708-99d5-26cbdb68ab17 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:39.377329 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3606070c-f8d8-4400-9943-3287ae1f068f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.160115 Nov 19 03:21:39.377998 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 155/293] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:39 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:39.386812 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b0f4af84-ddfe-4708-99d5-26cbdb68ab17 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:39.386812 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b0f4af84-ddfe-4708-99d5-26cbdb68ab17 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:39.386812 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b0f4af84-ddfe-4708-99d5-26cbdb68ab17 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:39.386812 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b0f4af84-ddfe-4708-99d5-26cbdb68ab17 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:39.412975 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b0f4af84-ddfe-4708-99d5-26cbdb68ab17 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:39.413417 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b0f4af84-ddfe-4708-99d5-26cbdb68ab17 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:39.413851 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.objects.instance [None req-b0f4af84-ddfe-4708-99d5-26cbdb68ab17 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lazy-loading 'fault' on Instance uuid c9ce8291-c6df-4afe-a958-5b8ef4c447fd {{(pid=116066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:21:39.455562 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b0f4af84-ddfe-4708-99d5-26cbdb68ab17 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64cb4b68c3b4469e8d23f2398a840f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46ab2df10b434fa30ee9c1f01c8e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:39.463497 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b0f4af84-ddfe-4708-99d5-26cbdb68ab17 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 200 len: 1304 microversion: 2.1 time: 0.098630 Nov 19 03:21:39.464064 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 139/294] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:39 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:39.734935 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1718106335", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "networks": [{"uuid": "cd122154-2aeb-4e66-bcc7-7acf31cd258e"}]}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:39.798426 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.network.neutron [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] validate_networks() for [('cd122154-2aeb-4e66-bcc7-7acf31cd258e', None, None, None, None, None)] {{(pid=116065) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:21:39.997655 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-04338622-9d4b-4705-ae2d-6032fc7ea291 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:39.998937 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-04338622-9d4b-4705-ae2d-6032fc7ea291 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:40.005607 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04338622-9d4b-4705-ae2d-6032fc7ea291 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:40.006121 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04338622-9d4b-4705-ae2d-6032fc7ea291 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:40.006989 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04338622-9d4b-4705-ae2d-6032fc7ea291 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:40.007479 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04338622-9d4b-4705-ae2d-6032fc7ea291 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:40.106344 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-04338622-9d4b-4705-ae2d-6032fc7ea291 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 27878 microversion: 2.20 time: 0.112185 Nov 19 03:21:40.107026 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 140/295] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:39 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 27878 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:21:40.172070 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Flavor limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:21:40.172489 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Image limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:21:40.173017 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Flavor pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:21:40.173446 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Image pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:21:40.173854 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:21:40.182461 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:40.182930 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:40.183736 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:40.184168 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:40.200333 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Getting quotas for project 53690eedb4c749db94ed55f64a323cba. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:21:40.205026 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Getting quotas for user 96438e8630f848a8879dbd29e687d1c1 and project 53690eedb4c749db94ed55f64a323cba. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:21:40.215364 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Going to run 1 instances... {{(pid=116065) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:21:40.217615 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:21:40.263175 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1f487657-3346-4206-9e83-75a71bdd39ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533198 Nov 19 03:21:40.264163 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 156/296] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:21:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:21:40.275067 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-bb596288-0f1e-4584-a562-1a123d221e32 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:40.275757 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-bb596288-0f1e-4584-a562-1a123d221e32 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:40.331675 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-bb596288-0f1e-4584-a562-1a123d221e32 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:40.338453 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-bb596288-0f1e-4584-a562-1a123d221e32 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1218 microversion: 2.1 time: 0.067647 Nov 19 03:21:40.339115 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 141/297] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:40 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:40.394534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ca4efddc-32db-4ee8-8e9d-dadae6386855 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:40.395142 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ca4efddc-32db-4ee8-8e9d-dadae6386855 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:40.403596 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ca4efddc-32db-4ee8-8e9d-dadae6386855 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:40.404037 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ca4efddc-32db-4ee8-8e9d-dadae6386855 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:40.404808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ca4efddc-32db-4ee8-8e9d-dadae6386855 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:40.405605 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ca4efddc-32db-4ee8-8e9d-dadae6386855 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:40.480807 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-df8bf194-33ed-4bc4-90bf-55b42eec78b1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:40.482271 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-df8bf194-33ed-4bc4-90bf-55b42eec78b1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:40.489003 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-df8bf194-33ed-4bc4-90bf-55b42eec78b1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:40.489455 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-df8bf194-33ed-4bc4-90bf-55b42eec78b1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:40.490298 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-df8bf194-33ed-4bc4-90bf-55b42eec78b1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:40.490754 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-df8bf194-33ed-4bc4-90bf-55b42eec78b1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:40.505473 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-df8bf194-33ed-4bc4-90bf-55b42eec78b1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] HTTP exception thrown: Instance c9ce8291-c6df-4afe-a958-5b8ef4c447fd could not be found. Nov 19 03:21:40.506098 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-df8bf194-33ed-4bc4-90bf-55b42eec78b1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Returning 404 to user: Instance c9ce8291-c6df-4afe-a958-5b8ef4c447fd could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:21:40.506983 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-df8bf194-33ed-4bc4-90bf-55b42eec78b1 tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 404 len: 111 microversion: 2.1 time: 0.030172 Nov 19 03:21:40.507856 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 142/298] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:40 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 03:21:40.556688 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ca4efddc-32db-4ee8-8e9d-dadae6386855 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:40.565590 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ca4efddc-32db-4ee8-8e9d-dadae6386855 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.175407 Nov 19 03:21:40.566275 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 157/299] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:40 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:40.620846 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-925de08d-d817-4cb9-b93b-fc07dc381a1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:40.622104 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-925de08d-d817-4cb9-b93b-fc07dc381a1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:40.629858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-925de08d-d817-4cb9-b93b-fc07dc381a1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:40.630613 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-925de08d-d817-4cb9-b93b-fc07dc381a1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:40.631720 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-925de08d-d817-4cb9-b93b-fc07dc381a1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:40.632535 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-925de08d-d817-4cb9-b93b-fc07dc381a1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:40.657693 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-925de08d-d817-4cb9-b93b-fc07dc381a1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] HTTP exception thrown: Instance c9ce8291-c6df-4afe-a958-5b8ef4c447fd could not be found. Nov 19 03:21:40.658349 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-925de08d-d817-4cb9-b93b-fc07dc381a1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Returning 404 to user: Instance c9ce8291-c6df-4afe-a958-5b8ef4c447fd could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:21:40.659266 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-925de08d-d817-4cb9-b93b-fc07dc381a1b tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042637 Nov 19 03:21:40.659882 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 143/300] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:21:40 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:21:41.118232 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-43b134ec-8a2f-4945-ab53-9d7bce8bf105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:41.119220 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-43b134ec-8a2f-4945-ab53-9d7bce8bf105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:41.125336 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-43b134ec-8a2f-4945-ab53-9d7bce8bf105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:41.125780 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-43b134ec-8a2f-4945-ab53-9d7bce8bf105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:41.126582 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-43b134ec-8a2f-4945-ab53-9d7bce8bf105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:41.127011 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-43b134ec-8a2f-4945-ab53-9d7bce8bf105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:41.355849 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-168f5a8f-e156-473f-a609-25e56ce0e773 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:41.356354 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-168f5a8f-e156-473f-a609-25e56ce0e773 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:41.363920 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-168f5a8f-e156-473f-a609-25e56ce0e773 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:41.364416 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-168f5a8f-e156-473f-a609-25e56ce0e773 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:41.365260 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-168f5a8f-e156-473f-a609-25e56ce0e773 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:41.365693 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-168f5a8f-e156-473f-a609-25e56ce0e773 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:41.426676 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-168f5a8f-e156-473f-a609-25e56ce0e773 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:41.434035 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-168f5a8f-e156-473f-a609-25e56ce0e773 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1270 microversion: 2.1 time: 0.081892 Nov 19 03:21:41.434645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 144/301] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:41 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:41.582046 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-66f9279b-dc12-41df-8330-c37accdb4c59 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:41.582791 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-66f9279b-dc12-41df-8330-c37accdb4c59 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:41.588663 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-66f9279b-dc12-41df-8330-c37accdb4c59 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:41.589388 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-66f9279b-dc12-41df-8330-c37accdb4c59 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:41.590799 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-66f9279b-dc12-41df-8330-c37accdb4c59 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:41.591539 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-66f9279b-dc12-41df-8330-c37accdb4c59 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:41.703705 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-43b134ec-8a2f-4945-ab53-9d7bce8bf105 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28102 microversion: 2.20 time: 0.588662 Nov 19 03:21:41.704891 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 158/302] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:41 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28102 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:41.729691 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-66f9279b-dc12-41df-8330-c37accdb4c59 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:41.737487 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-66f9279b-dc12-41df-8330-c37accdb4c59 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.159273 Nov 19 03:21:41.738053 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 145/303] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:41 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:41.963142 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8f74e6a2-44bf-476c-98bb-d922c3c4f3ec tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:41.963796 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8f74e6a2-44bf-476c-98bb-d922c3c4f3ec tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:41.972578 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f74e6a2-44bf-476c-98bb-d922c3c4f3ec tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:41.973017 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f74e6a2-44bf-476c-98bb-d922c3c4f3ec tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:41.973798 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f74e6a2-44bf-476c-98bb-d922c3c4f3ec tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:41.974405 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f74e6a2-44bf-476c-98bb-d922c3c4f3ec tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:41.991496 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-8f74e6a2-44bf-476c-98bb-d922c3c4f3ec tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] HTTP exception thrown: Instance c9ce8291-c6df-4afe-a958-5b8ef4c447fd could not be found. Nov 19 03:21:41.992631 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8f74e6a2-44bf-476c-98bb-d922c3c4f3ec tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Returning 404 to user: Instance c9ce8291-c6df-4afe-a958-5b8ef4c447fd could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:21:41.993463 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8f74e6a2-44bf-476c-98bb-d922c3c4f3ec tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 404 len: 111 microversion: 2.1 time: 0.034814 Nov 19 03:21:41.994384 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 159/304] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:21:41 2021] DELETE /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 03:21:42.002657 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-41892df2-9ec8-411c-8b23-b1a91e6068ef tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:42.003267 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-41892df2-9ec8-411c-8b23-b1a91e6068ef tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] [instance: c9ce8291-c6df-4afe-a958-5b8ef4c447fd] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:42.010038 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-41892df2-9ec8-411c-8b23-b1a91e6068ef tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:42.011564 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-41892df2-9ec8-411c-8b23-b1a91e6068ef tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:42.012377 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-41892df2-9ec8-411c-8b23-b1a91e6068ef tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:42.013176 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-41892df2-9ec8-411c-8b23-b1a91e6068ef tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:42.028533 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-41892df2-9ec8-411c-8b23-b1a91e6068ef tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] HTTP exception thrown: Instance c9ce8291-c6df-4afe-a958-5b8ef4c447fd could not be found. Nov 19 03:21:42.029262 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-41892df2-9ec8-411c-8b23-b1a91e6068ef tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] Returning 404 to user: Instance c9ce8291-c6df-4afe-a958-5b8ef4c447fd could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:21:42.030087 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-41892df2-9ec8-411c-8b23-b1a91e6068ef tempest-DeleteServersTestJSON-870213063 tempest-DeleteServersTestJSON-870213063-project] 10.222.0.47 "GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd" status: 404 len: 111 microversion: 2.1 time: 0.031553 Nov 19 03:21:42.031326 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 146/305] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:41 2021] GET /compute/v2.1/servers/c9ce8291-c6df-4afe-a958-5b8ef4c447fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 03:21:42.462302 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b552e517-6c5b-4850-b857-b836533c0f56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:42.464602 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b552e517-6c5b-4850-b857-b836533c0f56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:42.473740 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b552e517-6c5b-4850-b857-b836533c0f56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:42.485846 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b552e517-6c5b-4850-b857-b836533c0f56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:42.489251 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b552e517-6c5b-4850-b857-b836533c0f56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:42.490598 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b552e517-6c5b-4850-b857-b836533c0f56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:42.641854 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b552e517-6c5b-4850-b857-b836533c0f56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:42.679912 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b552e517-6c5b-4850-b857-b836533c0f56 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1276 microversion: 2.1 time: 0.229463 Nov 19 03:21:42.681377 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 160/306] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:42 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1276 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:42.716443 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e8231861-2299-40f7-b7e7-a01687274b30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:42.717457 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e8231861-2299-40f7-b7e7-a01687274b30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:42.737703 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e8231861-2299-40f7-b7e7-a01687274b30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:42.740076 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e8231861-2299-40f7-b7e7-a01687274b30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:42.740934 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e8231861-2299-40f7-b7e7-a01687274b30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:42.741424 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e8231861-2299-40f7-b7e7-a01687274b30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:42.754459 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-dd9c1e55-a77a-433b-812f-7a561a45c81d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:42.755161 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-dd9c1e55-a77a-433b-812f-7a561a45c81d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:42.764367 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd9c1e55-a77a-433b-812f-7a561a45c81d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:42.768656 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd9c1e55-a77a-433b-812f-7a561a45c81d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:42.784382 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd9c1e55-a77a-433b-812f-7a561a45c81d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:42.784996 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd9c1e55-a77a-433b-812f-7a561a45c81d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:42.879245 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e8231861-2299-40f7-b7e7-a01687274b30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28162 microversion: 2.20 time: 0.167048 Nov 19 03:21:42.880965 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 147/307] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:42 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28162 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:43.130784 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-dd9c1e55-a77a-433b-812f-7a561a45c81d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:43.144970 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-dd9c1e55-a77a-433b-812f-7a561a45c81d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1523 microversion: 2.1 time: 0.393884 Nov 19 03:21:43.145867 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 161/308] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:42 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1523 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:43.699940 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-be6a9bea-21c9-483f-8eea-1d8b68ceec6a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:43.700590 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-be6a9bea-21c9-483f-8eea-1d8b68ceec6a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:43.719225 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be6a9bea-21c9-483f-8eea-1d8b68ceec6a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:43.722660 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be6a9bea-21c9-483f-8eea-1d8b68ceec6a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:43.725053 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be6a9bea-21c9-483f-8eea-1d8b68ceec6a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:43.726744 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be6a9bea-21c9-483f-8eea-1d8b68ceec6a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:43.902003 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-04ce5df8-306a-447f-a8ca-357c1fd8ee2f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:43.903214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-04ce5df8-306a-447f-a8ca-357c1fd8ee2f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:43.918779 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-04ce5df8-306a-447f-a8ca-357c1fd8ee2f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:43.922808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-04ce5df8-306a-447f-a8ca-357c1fd8ee2f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:43.929866 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-04ce5df8-306a-447f-a8ca-357c1fd8ee2f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:43.930389 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-04ce5df8-306a-447f-a8ca-357c1fd8ee2f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:44.003199 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-be6a9bea-21c9-483f-8eea-1d8b68ceec6a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:44.015283 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-be6a9bea-21c9-483f-8eea-1d8b68ceec6a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1318 microversion: 2.1 time: 0.320891 Nov 19 03:21:44.025096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 148/309] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:43 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:44.058840 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-04ce5df8-306a-447f-a8ca-357c1fd8ee2f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28162 microversion: 2.20 time: 0.169835 Nov 19 03:21:44.063438 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 162/310] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:43 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28162 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:44.164756 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4f1e2c3c-8eed-4416-9917-4dc28d04e9ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:44.165782 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4f1e2c3c-8eed-4416-9917-4dc28d04e9ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:44.173949 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4f1e2c3c-8eed-4416-9917-4dc28d04e9ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:44.174677 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4f1e2c3c-8eed-4416-9917-4dc28d04e9ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:44.175712 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4f1e2c3c-8eed-4416-9917-4dc28d04e9ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:44.176220 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4f1e2c3c-8eed-4416-9917-4dc28d04e9ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:44.365482 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-6aaa451e-c504-487e-b06d-37bb39707b0c req-284941f2-03c2-4c10-b961-bd6ad5fb2200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824fcf10-8c9b-461d-8206-1c9ae5d4011b", "tag": "004bc3b2-8042-48ab-abde-62fc17b827d2"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:44.367667 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:21:44.367667 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:21:44.382446 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-6aaa451e-c504-487e-b06d-37bb39707b0c req-284941f2-03c2-4c10-b961-bd6ad5fb2200 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:44.382913 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-6aaa451e-c504-487e-b06d-37bb39707b0c req-284941f2-03c2-4c10-b961-bd6ad5fb2200 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:44.405253 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-6aaa451e-c504-487e-b06d-37bb39707b0c req-284941f2-03c2-4c10-b961-bd6ad5fb2200 service nova] Creating event network-changed:004bc3b2-8042-48ab-abde-62fc17b827d2 for instance 824fcf10-8c9b-461d-8206-1c9ae5d4011b on hv-cinder-81803 Nov 19 03:21:44.411733 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-6aaa451e-c504-487e-b06d-37bb39707b0c req-284941f2-03c2-4c10-b961-bd6ad5fb2200 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051451 Nov 19 03:21:44.412530 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 163/311] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:21:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:21:44.427460 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-4f1e2c3c-8eed-4416-9917-4dc28d04e9ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:44.445067 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4f1e2c3c-8eed-4416-9917-4dc28d04e9ea tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1503 microversion: 2.1 time: 0.283824 Nov 19 03:21:44.445848 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 149/312] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:44 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:44.463481 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-741b7586-badd-446d-9096-56f40f5258b3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:44.468866 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-741b7586-badd-446d-9096-56f40f5258b3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:44.479820 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-741b7586-badd-446d-9096-56f40f5258b3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:44.480958 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-741b7586-badd-446d-9096-56f40f5258b3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:44.481916 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-741b7586-badd-446d-9096-56f40f5258b3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:44.482939 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-741b7586-badd-446d-9096-56f40f5258b3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:44.791961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-741b7586-badd-446d-9096-56f40f5258b3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:44.800603 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-741b7586-badd-446d-9096-56f40f5258b3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1517 microversion: 2.1 time: 0.341089 Nov 19 03:21:44.801517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 164/313] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:44 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1517 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:45.032722 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-69ab5b4f-ee8c-4ce0-86a8-510baa4ecb9c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:45.033341 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-69ab5b4f-ee8c-4ce0-86a8-510baa4ecb9c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:45.045947 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-69ab5b4f-ee8c-4ce0-86a8-510baa4ecb9c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:45.046884 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-69ab5b4f-ee8c-4ce0-86a8-510baa4ecb9c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:45.047957 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-69ab5b4f-ee8c-4ce0-86a8-510baa4ecb9c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:45.048393 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-69ab5b4f-ee8c-4ce0-86a8-510baa4ecb9c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:45.070903 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-23f71343-fd9e-4538-a316-44732e7ad49b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:45.072398 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-23f71343-fd9e-4538-a316-44732e7ad49b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:45.080505 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-23f71343-fd9e-4538-a316-44732e7ad49b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:45.082750 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-23f71343-fd9e-4538-a316-44732e7ad49b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:45.084967 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-23f71343-fd9e-4538-a316-44732e7ad49b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:45.088006 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-23f71343-fd9e-4538-a316-44732e7ad49b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:45.388619 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-69ab5b4f-ee8c-4ce0-86a8-510baa4ecb9c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:45.398030 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-69ab5b4f-ee8c-4ce0-86a8-510baa4ecb9c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1318 microversion: 2.1 time: 0.369133 Nov 19 03:21:45.399292 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 150/314] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:45 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:45.456015 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-23f71343-fd9e-4538-a316-44732e7ad49b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28162 microversion: 2.20 time: 0.388510 Nov 19 03:21:45.457817 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 165/315] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:45 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28162 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:46.314678 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-31a89922-4bf3-4108-acae-e4b1a32b49af tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:46.318689 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-31a89922-4bf3-4108-acae-e4b1a32b49af tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:46.340581 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-31a89922-4bf3-4108-acae-e4b1a32b49af tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:46.341323 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-31a89922-4bf3-4108-acae-e4b1a32b49af tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:46.342732 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-31a89922-4bf3-4108-acae-e4b1a32b49af tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:46.344055 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-31a89922-4bf3-4108-acae-e4b1a32b49af tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:46.416955 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-20c5d9a8-7c1e-4734-b1d2-d7a6a99e4ac8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:46.418098 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-20c5d9a8-7c1e-4734-b1d2-d7a6a99e4ac8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:46.422048 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.objects.instance [None req-31a89922-4bf3-4108-acae-e4b1a32b49af tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'flavor' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:21:46.439846 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-20c5d9a8-7c1e-4734-b1d2-d7a6a99e4ac8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:46.440325 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-20c5d9a8-7c1e-4734-b1d2-d7a6a99e4ac8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:46.441154 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-20c5d9a8-7c1e-4734-b1d2-d7a6a99e4ac8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:46.441589 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-20c5d9a8-7c1e-4734-b1d2-d7a6a99e4ac8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:46.662951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-31a89922-4bf3-4108-acae-e4b1a32b49af tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "POST /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/action" status: 200 len: 32 microversion: 2.1 time: 0.358614 Nov 19 03:21:46.664181 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 151/316] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:21:46 2021] POST /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/action => generated 32 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:21:46.675322 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-efb7eeca-f14e-4b2a-a161-e2fcd3597ea7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:46.676737 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-efb7eeca-f14e-4b2a-a161-e2fcd3597ea7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:46.690068 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-efb7eeca-f14e-4b2a-a161-e2fcd3597ea7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:46.691761 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-efb7eeca-f14e-4b2a-a161-e2fcd3597ea7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:46.694253 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-efb7eeca-f14e-4b2a-a161-e2fcd3597ea7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:46.695020 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-efb7eeca-f14e-4b2a-a161-e2fcd3597ea7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:46.816112 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-efb7eeca-f14e-4b2a-a161-e2fcd3597ea7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28162 microversion: 2.20 time: 0.148058 Nov 19 03:21:46.821624 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 152/317] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:46 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28162 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:46.828991 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6109698f-2b59-4b4d-8f13-a5e076115beb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:46.832321 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6109698f-2b59-4b4d-8f13-a5e076115beb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:46.852253 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6109698f-2b59-4b4d-8f13-a5e076115beb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:46.853035 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6109698f-2b59-4b4d-8f13-a5e076115beb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:46.854839 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6109698f-2b59-4b4d-8f13-a5e076115beb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:46.857059 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6109698f-2b59-4b4d-8f13-a5e076115beb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:47.266724 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-20c5d9a8-7c1e-4734-b1d2-d7a6a99e4ac8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:47.275397 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-20c5d9a8-7c1e-4734-b1d2-d7a6a99e4ac8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1318 microversion: 2.1 time: 0.862249 Nov 19 03:21:47.281434 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 166/318] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:46 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1318 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:47.419406 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-6109698f-2b59-4b4d-8f13-a5e076115beb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:47.428128 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6109698f-2b59-4b4d-8f13-a5e076115beb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.603940 Nov 19 03:21:47.431648 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 153/319] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:46 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:47.830164 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b7cd2d2d-f719-4b5b-9396-f04f0242d68e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:47.831691 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b7cd2d2d-f719-4b5b-9396-f04f0242d68e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:47.878926 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b7cd2d2d-f719-4b5b-9396-f04f0242d68e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:47.879545 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b7cd2d2d-f719-4b5b-9396-f04f0242d68e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:47.880622 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b7cd2d2d-f719-4b5b-9396-f04f0242d68e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:47.881331 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b7cd2d2d-f719-4b5b-9396-f04f0242d68e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:48.085067 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b7cd2d2d-f719-4b5b-9396-f04f0242d68e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28162 microversion: 2.20 time: 0.259307 Nov 19 03:21:48.085699 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 167/320] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:47 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28162 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:48.293518 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-bc905d72-31e3-4f6b-afc0-09867c710661 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:48.295184 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-bc905d72-31e3-4f6b-afc0-09867c710661 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:48.341154 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bc905d72-31e3-4f6b-afc0-09867c710661 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:48.341645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bc905d72-31e3-4f6b-afc0-09867c710661 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:48.342587 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bc905d72-31e3-4f6b-afc0-09867c710661 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:48.343120 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bc905d72-31e3-4f6b-afc0-09867c710661 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:48.450600 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-bb329862-1833-4af2-9624-f0b7e0d4d640 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:48.451313 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-bb329862-1833-4af2-9624-f0b7e0d4d640 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:48.465645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bb329862-1833-4af2-9624-f0b7e0d4d640 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:48.467341 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bb329862-1833-4af2-9624-f0b7e0d4d640 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:48.469401 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bb329862-1833-4af2-9624-f0b7e0d4d640 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:48.474213 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bb329862-1833-4af2-9624-f0b7e0d4d640 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:49.126248 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-bb329862-1833-4af2-9624-f0b7e0d4d640 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:49.137803 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-bb329862-1833-4af2-9624-f0b7e0d4d640 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.692070 Nov 19 03:21:49.140362 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 168/321] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:48 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:49.154529 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-cf979215-9c72-436c-96be-77f9a452b6f7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:49.156258 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-cf979215-9c72-436c-96be-77f9a452b6f7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:49.160845 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-bc905d72-31e3-4f6b-afc0-09867c710661 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:49.163355 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cf979215-9c72-436c-96be-77f9a452b6f7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:49.164035 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cf979215-9c72-436c-96be-77f9a452b6f7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:49.165444 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cf979215-9c72-436c-96be-77f9a452b6f7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:49.166041 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cf979215-9c72-436c-96be-77f9a452b6f7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:49.169928 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-bc905d72-31e3-4f6b-afc0-09867c710661 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1318 microversion: 2.1 time: 0.880778 Nov 19 03:21:49.182569 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 154/322] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:48 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1318 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:49.345122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-cf979215-9c72-436c-96be-77f9a452b6f7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28162 microversion: 2.20 time: 0.193984 Nov 19 03:21:49.350861 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 169/323] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:49 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28162 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:50.161422 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-dd36c8dc-d740-4747-8cdd-4b1181cd4b91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:50.164288 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-dd36c8dc-d740-4747-8cdd-4b1181cd4b91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:50.175742 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dd36c8dc-d740-4747-8cdd-4b1181cd4b91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:50.176516 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dd36c8dc-d740-4747-8cdd-4b1181cd4b91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:50.177841 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dd36c8dc-d740-4747-8cdd-4b1181cd4b91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:50.178524 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dd36c8dc-d740-4747-8cdd-4b1181cd4b91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:50.191054 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d6757026-20d6-49a6-9a8c-844d0cb35e9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:50.191662 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d6757026-20d6-49a6-9a8c-844d0cb35e9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:50.210712 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d6757026-20d6-49a6-9a8c-844d0cb35e9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:50.211165 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d6757026-20d6-49a6-9a8c-844d0cb35e9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:50.211957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d6757026-20d6-49a6-9a8c-844d0cb35e9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:50.212395 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d6757026-20d6-49a6-9a8c-844d0cb35e9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:50.412433 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-dd36c8dc-d740-4747-8cdd-4b1181cd4b91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:50.424310 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-dd36c8dc-d740-4747-8cdd-4b1181cd4b91 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.270237 Nov 19 03:21:50.426918 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 155/324] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:50 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:50.446392 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b284cb29-dbf5-42af-8e45-3689dfb12380 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:50.449281 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b284cb29-dbf5-42af-8e45-3689dfb12380 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:50.457179 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b284cb29-dbf5-42af-8e45-3689dfb12380 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:50.457864 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b284cb29-dbf5-42af-8e45-3689dfb12380 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:50.458856 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b284cb29-dbf5-42af-8e45-3689dfb12380 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:50.459445 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b284cb29-dbf5-42af-8e45-3689dfb12380 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:50.490784 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d6757026-20d6-49a6-9a8c-844d0cb35e9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:50.500695 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d6757026-20d6-49a6-9a8c-844d0cb35e9b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1318 microversion: 2.1 time: 0.314098 Nov 19 03:21:50.509816 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 170/325] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:50 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:50.586745 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b284cb29-dbf5-42af-8e45-3689dfb12380 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28162 microversion: 2.20 time: 0.144625 Nov 19 03:21:50.587394 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 156/326] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:50 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28162 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:51.444580 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d95d2536-9337-4b05-b1c5-9216943c6be5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:51.445976 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d95d2536-9337-4b05-b1c5-9216943c6be5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:51.463674 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d95d2536-9337-4b05-b1c5-9216943c6be5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:51.467319 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d95d2536-9337-4b05-b1c5-9216943c6be5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:51.468693 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d95d2536-9337-4b05-b1c5-9216943c6be5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:51.469105 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d95d2536-9337-4b05-b1c5-9216943c6be5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:51.521651 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-bb17efa6-cfee-40cf-9a79-c65553d269ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:51.523133 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-bb17efa6-cfee-40cf-9a79-c65553d269ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:51.538612 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bb17efa6-cfee-40cf-9a79-c65553d269ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:51.539337 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bb17efa6-cfee-40cf-9a79-c65553d269ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:51.540295 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bb17efa6-cfee-40cf-9a79-c65553d269ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:51.540890 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bb17efa6-cfee-40cf-9a79-c65553d269ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:51.936526 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d95d2536-9337-4b05-b1c5-9216943c6be5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:51.949032 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d95d2536-9337-4b05-b1c5-9216943c6be5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.509754 Nov 19 03:21:51.950079 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 171/327] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:51 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:51.964786 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-54e981ba-0749-4e3b-afe7-a32e2ee40e84 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:51.965825 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-54e981ba-0749-4e3b-afe7-a32e2ee40e84 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:51.990004 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-54e981ba-0749-4e3b-afe7-a32e2ee40e84 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:51.991995 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-54e981ba-0749-4e3b-afe7-a32e2ee40e84 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:51.992912 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-54e981ba-0749-4e3b-afe7-a32e2ee40e84 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:51.999639 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-54e981ba-0749-4e3b-afe7-a32e2ee40e84 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:52.033794 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-bb17efa6-cfee-40cf-9a79-c65553d269ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:52.043518 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-bb17efa6-cfee-40cf-9a79-c65553d269ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1318 microversion: 2.1 time: 0.525806 Nov 19 03:21:52.047008 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 157/328] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:51 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:52.059810 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-280c01fc-064b-41e6-8c87-2bb5518fedb4 req-3b7a2ee0-9b0e-49a5-a80f-0ae2f0ed5a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824fcf10-8c9b-461d-8206-1c9ae5d4011b", "name": "network-vif-plugged", "status": "completed", "tag": "004bc3b2-8042-48ab-abde-62fc17b827d2"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:52.062509 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:21:52.062509 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:21:52.085204 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-280c01fc-064b-41e6-8c87-2bb5518fedb4 req-3b7a2ee0-9b0e-49a5-a80f-0ae2f0ed5a76 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:52.085932 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-280c01fc-064b-41e6-8c87-2bb5518fedb4 req-3b7a2ee0-9b0e-49a5-a80f-0ae2f0ed5a76 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:52.105659 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-280c01fc-064b-41e6-8c87-2bb5518fedb4 req-3b7a2ee0-9b0e-49a5-a80f-0ae2f0ed5a76 service nova] Creating event network-vif-plugged:004bc3b2-8042-48ab-abde-62fc17b827d2 for instance 824fcf10-8c9b-461d-8206-1c9ae5d4011b on hv-cinder-81803 Nov 19 03:21:52.112813 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-280c01fc-064b-41e6-8c87-2bb5518fedb4 req-3b7a2ee0-9b0e-49a5-a80f-0ae2f0ed5a76 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063494 Nov 19 03:21:52.114717 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 158/329] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:21:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:21:52.191584 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-54e981ba-0749-4e3b-afe7-a32e2ee40e84 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28162 microversion: 2.20 time: 0.238108 Nov 19 03:21:52.192651 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 172/330] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:51 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28162 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:52.968594 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-135f7f9f-1d7b-415a-84db-facf544f5966 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:52.969395 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-135f7f9f-1d7b-415a-84db-facf544f5966 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:52.987106 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-135f7f9f-1d7b-415a-84db-facf544f5966 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:52.988727 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-135f7f9f-1d7b-415a-84db-facf544f5966 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:52.991669 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-135f7f9f-1d7b-415a-84db-facf544f5966 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:52.993533 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-135f7f9f-1d7b-415a-84db-facf544f5966 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:53.216992 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cb96c178-ab2c-4c44-a3cb-91769939790a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'create', calling method: .version_select at 0x7f845a39a670>, body: {"keypair": {"name": "tempest-keypair-777798237"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:53.241433 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-cb96c178-ab2c-4c44-a3cb-91769939790a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Getting quotas for project 47d64b0b6d824dcaa62fc05f714c4d3b. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:21:53.246814 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-cb96c178-ab2c-4c44-a3cb-91769939790a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Getting quotas for user 10f233fb185241e8a04f8ce5d27c0bd9 and project 47d64b0b6d824dcaa62fc05f714c4d3b. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:21:53.253093 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-135f7f9f-1d7b-415a-84db-facf544f5966 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:53.267453 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-135f7f9f-1d7b-415a-84db-facf544f5966 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.303559 Nov 19 03:21:53.268869 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 173/331] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:52 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:53.275189 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-beb20076-e9e6-49fc-9de8-09709f1fc4ce tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:53.276360 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-beb20076-e9e6-49fc-9de8-09709f1fc4ce tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:53.286212 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-beb20076-e9e6-49fc-9de8-09709f1fc4ce tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:53.286830 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-beb20076-e9e6-49fc-9de8-09709f1fc4ce tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:53.288049 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-beb20076-e9e6-49fc-9de8-09709f1fc4ce tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:53.289045 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-beb20076-e9e6-49fc-9de8-09709f1fc4ce tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:53.657606 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-beb20076-e9e6-49fc-9de8-09709f1fc4ce tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:53.669171 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-beb20076-e9e6-49fc-9de8-09709f1fc4ce tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1318 microversion: 2.1 time: 0.399173 Nov 19 03:21:53.669746 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 174/332] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:53 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:53.686053 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-291e64b6-7f81-4d94-8116-6283a186ce43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:53.690341 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-291e64b6-7f81-4d94-8116-6283a186ce43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:53.724057 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-291e64b6-7f81-4d94-8116-6283a186ce43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:53.725341 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-291e64b6-7f81-4d94-8116-6283a186ce43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:53.731517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-291e64b6-7f81-4d94-8116-6283a186ce43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:53.733183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-291e64b6-7f81-4d94-8116-6283a186ce43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:53.922840 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-cb96c178-ab2c-4c44-a3cb-91769939790a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Getting quotas for project 47d64b0b6d824dcaa62fc05f714c4d3b. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:21:53.933136 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-cb96c178-ab2c-4c44-a3cb-91769939790a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Getting quotas for user 10f233fb185241e8a04f8ce5d27c0bd9 and project 47d64b0b6d824dcaa62fc05f714c4d3b. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:21:53.967001 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-291e64b6-7f81-4d94-8116-6283a186ce43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28162 microversion: 2.20 time: 0.295592 Nov 19 03:21:53.967292 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cb96c178-ab2c-4c44-a3cb-91769939790a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.251646 Nov 19 03:21:53.970866 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 159/333] 10.222.0.47 () {60 vars in 1157 bytes} [Fri Nov 19 03:21:52 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:53.972154 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 175/334] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:53 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28162 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:54.285829 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-be3384ad-d4c6-48d0-a6c0-03b2e2bb5fb3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:54.287069 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-be3384ad-d4c6-48d0-a6c0-03b2e2bb5fb3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:54.298187 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be3384ad-d4c6-48d0-a6c0-03b2e2bb5fb3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:54.303501 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be3384ad-d4c6-48d0-a6c0-03b2e2bb5fb3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:54.304419 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be3384ad-d4c6-48d0-a6c0-03b2e2bb5fb3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:54.304857 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be3384ad-d4c6-48d0-a6c0-03b2e2bb5fb3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:54.685427 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4e7aecfb-3ee0-4a90-9fd7-a19c839ddd61 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:54.686368 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4e7aecfb-3ee0-4a90-9fd7-a19c839ddd61 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:54.708243 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e7aecfb-3ee0-4a90-9fd7-a19c839ddd61 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:54.708702 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e7aecfb-3ee0-4a90-9fd7-a19c839ddd61 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:54.709513 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e7aecfb-3ee0-4a90-9fd7-a19c839ddd61 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:54.709953 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e7aecfb-3ee0-4a90-9fd7-a19c839ddd61 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:54.787678 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-be3384ad-d4c6-48d0-a6c0-03b2e2bb5fb3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:54.808776 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-be3384ad-d4c6-48d0-a6c0-03b2e2bb5fb3 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.525160 Nov 19 03:21:54.813115 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 160/335] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:54 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:54.990174 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-91d5fee7-a5a8-4538-9e6f-dbe6f601fa25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:54.993756 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-91d5fee7-a5a8-4538-9e6f-dbe6f601fa25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:55.020381 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-91d5fee7-a5a8-4538-9e6f-dbe6f601fa25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:55.021426 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-91d5fee7-a5a8-4538-9e6f-dbe6f601fa25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:55.024254 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-91d5fee7-a5a8-4538-9e6f-dbe6f601fa25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:55.025177 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-91d5fee7-a5a8-4538-9e6f-dbe6f601fa25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:55.137520 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-91d5fee7-a5a8-4538-9e6f-dbe6f601fa25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28162 microversion: 2.20 time: 0.161107 Nov 19 03:21:55.138756 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 161/336] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:54 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28162 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:21:55.171886 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4e7aecfb-3ee0-4a90-9fd7-a19c839ddd61 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:55.182219 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4e7aecfb-3ee0-4a90-9fd7-a19c839ddd61 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1509 microversion: 2.1 time: 0.500750 Nov 19 03:21:55.187399 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 176/337] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:54 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1509 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:21:55.204738 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b13ce832-df19-43e8-91f9-d4d20ab97094 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c77155b1-aeba-41af-b24a-fd6c1877ba51"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:55.205986 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b13ce832-df19-43e8-91f9-d4d20ab97094 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:55.232517 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b13ce832-df19-43e8-91f9-d4d20ab97094 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:55.234120 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b13ce832-df19-43e8-91f9-d4d20ab97094 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:55.238318 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b13ce832-df19-43e8-91f9-d4d20ab97094 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:55.238789 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b13ce832-df19-43e8-91f9-d4d20ab97094 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:55.434379 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-b13ce832-df19-43e8-91f9-d4d20ab97094 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] HTTP exception thrown: Invalid volume: volume c77155b1-aeba-41af-b24a-fd6c1877ba51 is already attached to instances: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 Nov 19 03:21:55.437524 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b13ce832-df19-43e8-91f9-d4d20ab97094 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Returning 400 to user: Invalid volume: volume c77155b1-aeba-41af-b24a-fd6c1877ba51 is already attached to instances: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:21:55.440023 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b13ce832-df19-43e8-91f9-d4d20ab97094 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "POST /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.240253 Nov 19 03:21:55.441092 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 162/338] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:21:55 2021] POST /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b/os-volume_attachments => generated 174 bytes in 242 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 03:21:55.570553 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1b5f1877-a112-4312-b762-510166a2ba87 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:55.571375 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1b5f1877-a112-4312-b762-510166a2ba87 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:55.584007 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1b5f1877-a112-4312-b762-510166a2ba87 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:55.584461 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1b5f1877-a112-4312-b762-510166a2ba87 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:55.589199 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1b5f1877-a112-4312-b762-510166a2ba87 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:55.589728 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1b5f1877-a112-4312-b762-510166a2ba87 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:55.830435 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8eff702e-4c24-4aea-a54f-01e20ec7a555 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:55.831519 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8eff702e-4c24-4aea-a54f-01e20ec7a555 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:55.848867 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8eff702e-4c24-4aea-a54f-01e20ec7a555 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:55.849326 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8eff702e-4c24-4aea-a54f-01e20ec7a555 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:55.850123 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8eff702e-4c24-4aea-a54f-01e20ec7a555 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:55.854300 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8eff702e-4c24-4aea-a54f-01e20ec7a555 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:55.972619 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-1b5f1877-a112-4312-b762-510166a2ba87 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lazy-loading 'services' on Instance uuid 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:21:56.182808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1b5f1877-a112-4312-b762-510166a2ba87 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4/os-volume_attachments/c77155b1-aeba-41af-b24a-fd6c1877ba51" status: 202 len: 0 microversion: 2.1 time: 0.616229 Nov 19 03:21:56.184262 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 177/339] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Nov 19 03:21:55 2021] DELETE /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4/os-volume_attachments/c77155b1-aeba-41af-b24a-fd6c1877ba51 => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:56.195156 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-35a615a3-3155-46fa-a658-631ba2d7a0a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:56.197422 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-35a615a3-3155-46fa-a658-631ba2d7a0a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:56.216901 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-35a615a3-3155-46fa-a658-631ba2d7a0a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:56.217363 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-35a615a3-3155-46fa-a658-631ba2d7a0a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:56.229534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-35a615a3-3155-46fa-a658-631ba2d7a0a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:56.230035 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-35a615a3-3155-46fa-a658-631ba2d7a0a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:56.392509 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-35a615a3-3155-46fa-a658-631ba2d7a0a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28162 microversion: 2.20 time: 0.206365 Nov 19 03:21:56.396823 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 178/340] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:56 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28162 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:56.400780 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-bc2fcb64-b3f3-4599-b304-5afa4e1caddd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:56.402420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-bc2fcb64-b3f3-4599-b304-5afa4e1caddd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:56.419488 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bc2fcb64-b3f3-4599-b304-5afa4e1caddd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:56.419942 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bc2fcb64-b3f3-4599-b304-5afa4e1caddd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:56.421836 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bc2fcb64-b3f3-4599-b304-5afa4e1caddd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:56.422644 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bc2fcb64-b3f3-4599-b304-5afa4e1caddd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:56.538383 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-bc2fcb64-b3f3-4599-b304-5afa4e1caddd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141675 Nov 19 03:21:56.542729 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 179/341] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:21:56 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:21:56.805880 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8eff702e-4c24-4aea-a54f-01e20ec7a555 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:56.818041 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8eff702e-4c24-4aea-a54f-01e20ec7a555 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.992198 Nov 19 03:21:56.828911 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 163/342] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:55 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:57.408395 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-75b157b3-027a-4c1f-a3ca-29e5769167e9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:57.409431 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-75b157b3-027a-4c1f-a3ca-29e5769167e9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:57.427300 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-75b157b3-027a-4c1f-a3ca-29e5769167e9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:57.428732 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-75b157b3-027a-4c1f-a3ca-29e5769167e9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:57.432023 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-75b157b3-027a-4c1f-a3ca-29e5769167e9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:57.432648 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-75b157b3-027a-4c1f-a3ca-29e5769167e9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:57.549678 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-aee1fd46-a43a-4970-8f33-1517fe179a4c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:57.550738 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-aee1fd46-a43a-4970-8f33-1517fe179a4c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:57.561429 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aee1fd46-a43a-4970-8f33-1517fe179a4c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:57.566373 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aee1fd46-a43a-4970-8f33-1517fe179a4c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:57.566969 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-75b157b3-027a-4c1f-a3ca-29e5769167e9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28453 microversion: 2.20 time: 0.165693 Nov 19 03:21:57.568279 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 180/343] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:57 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:57.570625 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aee1fd46-a43a-4970-8f33-1517fe179a4c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:57.573964 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aee1fd46-a43a-4970-8f33-1517fe179a4c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:57.620992 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-aee1fd46-a43a-4970-8f33-1517fe179a4c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075246 Nov 19 03:21:57.622270 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 164/344] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:21:57 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:21:57.837088 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-dd7f61d8-2c1e-4acb-921a-4fba6ffad4d7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:57.837778 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-dd7f61d8-2c1e-4acb-921a-4fba6ffad4d7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:57.850104 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd7f61d8-2c1e-4acb-921a-4fba6ffad4d7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:57.850937 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd7f61d8-2c1e-4acb-921a-4fba6ffad4d7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:57.851929 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd7f61d8-2c1e-4acb-921a-4fba6ffad4d7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:57.852571 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd7f61d8-2c1e-4acb-921a-4fba6ffad4d7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:58.248148 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-dd7f61d8-2c1e-4acb-921a-4fba6ffad4d7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:21:58.257246 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-dd7f61d8-2c1e-4acb-921a-4fba6ffad4d7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.424223 Nov 19 03:21:58.262831 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 181/345] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:21:57 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:21:58.579594 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e7885a42-83d0-4b67-84c3-ab04bf808a03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:58.580589 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e7885a42-83d0-4b67-84c3-ab04bf808a03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:58.589878 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e7885a42-83d0-4b67-84c3-ab04bf808a03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:58.590329 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e7885a42-83d0-4b67-84c3-ab04bf808a03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:58.591148 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e7885a42-83d0-4b67-84c3-ab04bf808a03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:58.594861 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e7885a42-83d0-4b67-84c3-ab04bf808a03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:58.633768 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4d8fa227-0b89-44d1-9914-18f52b767645 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:21:58.634756 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4d8fa227-0b89-44d1-9914-18f52b767645 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:21:58.649654 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d8fa227-0b89-44d1-9914-18f52b767645 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:58.650099 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d8fa227-0b89-44d1-9914-18f52b767645 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:58.651015 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d8fa227-0b89-44d1-9914-18f52b767645 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:21:58.651459 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d8fa227-0b89-44d1-9914-18f52b767645 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:21:58.752801 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e7885a42-83d0-4b67-84c3-ab04bf808a03 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28453 microversion: 2.20 time: 0.177103 Nov 19 03:21:58.753594 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 165/346] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:21:58 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:21:58.761418 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4d8fa227-0b89-44d1-9914-18f52b767645 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131639 Nov 19 03:21:58.761995 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 182/347] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:21:58 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:21:58.772025 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2113966238", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f425b87a-bd81-4b76-ae6d-df8730e55965"}], "security_groups": [{"name": "tempest-securitygroup--1339675439"}], "key_name": "tempest-keypair-777798237", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:58.988197 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.network.neutron [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] validate_networks() for [('f425b87a-bd81-4b76-ae6d-df8730e55965', None, None, None, None, None)] {{(pid=116066) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:21:59.056866 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1304214609", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "networks": [{"uuid": "cd122154-2aeb-4e66-bcc7-7acf31cd258e"}]}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:21:59.122224 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.network.neutron [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] validate_networks() for [('cd122154-2aeb-4e66-bcc7-7acf31cd258e', None, None, None, None, None)] {{(pid=116065) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:22:00.115398 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Flavor limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:22:00.115997 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Image limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:22:00.116626 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Flavor pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:22:00.117270 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Image pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:22:00.117891 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:22:00.143305 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:00.144112 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:00.145374 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:00.147899 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:00.212482 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Getting quotas for project 47d64b0b6d824dcaa62fc05f714c4d3b. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:22:00.228082 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Getting quotas for user 10f233fb185241e8a04f8ce5d27c0bd9 and project 47d64b0b6d824dcaa62fc05f714c4d3b. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:22:00.258226 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Going to run 1 instances... {{(pid=116066) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:22:00.262194 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:22:00.373085 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8a6c4f6b-0b64-41b9-a7a2-2439d04ef10e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.607959 Nov 19 03:22:00.376848 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 166/348] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:21:58 2021] POST /compute/v2.1/servers => generated 402 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:22:00.404212 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-60c79fe3-662f-4e4c-a351-75ce3f65b1cb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:00.405081 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-60c79fe3-662f-4e4c-a351-75ce3f65b1cb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:00.425365 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-60c79fe3-662f-4e4c-a351-75ce3f65b1cb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:00.429827 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-60c79fe3-662f-4e4c-a351-75ce3f65b1cb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:00.431221 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-60c79fe3-662f-4e4c-a351-75ce3f65b1cb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:00.433348 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-60c79fe3-662f-4e4c-a351-75ce3f65b1cb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:00.486286 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Flavor limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:22:00.487352 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Image limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:22:00.487833 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Flavor pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:22:00.488236 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Image pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:22:00.488647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:22:00.510117 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:00.510667 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:00.511535 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:00.511970 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:00.558188 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Getting quotas for project 53690eedb4c749db94ed55f64a323cba. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:22:00.574536 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Getting quotas for user 96438e8630f848a8879dbd29e687d1c1 and project 53690eedb4c749db94ed55f64a323cba. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:22:00.597442 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Going to run 1 instances... {{(pid=116065) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:22:00.599809 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:22:00.711669 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-46f26b0f-cf18-46af-8c41-35b269585a66 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659656 Nov 19 03:22:00.714946 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 183/349] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:21:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 03:22:00.725687 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-409870f6-6bd2-4670-a25f-126a4f701bcf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:00.728880 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-409870f6-6bd2-4670-a25f-126a4f701bcf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:00.737072 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-60c79fe3-662f-4e4c-a351-75ce3f65b1cb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:00.742988 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-409870f6-6bd2-4670-a25f-126a4f701bcf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:00.743641 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-409870f6-6bd2-4670-a25f-126a4f701bcf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:00.744760 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-409870f6-6bd2-4670-a25f-126a4f701bcf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:00.747876 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-409870f6-6bd2-4670-a25f-126a4f701bcf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:00.749737 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-60c79fe3-662f-4e4c-a351-75ce3f65b1cb tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1503 microversion: 2.1 time: 0.370707 Nov 19 03:22:00.751441 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 167/350] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:00 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1503 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:00.777599 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d22caaef-24cd-46bc-96cd-e26ccebf2fe1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:00.781033 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d22caaef-24cd-46bc-96cd-e26ccebf2fe1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:00.894394 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-409870f6-6bd2-4670-a25f-126a4f701bcf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.177840 Nov 19 03:22:00.895476 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 184/351] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:00 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:00.902181 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-50082cfb-c75e-4536-93eb-d962361bbcf2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:00.915167 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-50082cfb-c75e-4536-93eb-d962361bbcf2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:00.974321 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d22caaef-24cd-46bc-96cd-e26ccebf2fe1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:00.992055 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d22caaef-24cd-46bc-96cd-e26ccebf2fe1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1237 microversion: 2.1 time: 0.214376 Nov 19 03:22:00.992706 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 168/352] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:00 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1237 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:01.026744 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-74efdbc4-3eb6-4393-9f6f-2775f04d51ff tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9247b55-a80a-4753-8d32-7a0c913ce525"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:01.032789 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-74efdbc4-3eb6-4393-9f6f-2775f04d51ff tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:01.066904 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-74efdbc4-3eb6-4393-9f6f-2775f04d51ff tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:01.067719 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-74efdbc4-3eb6-4393-9f6f-2775f04d51ff tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:01.086991 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-74efdbc4-3eb6-4393-9f6f-2775f04d51ff tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:01.087479 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-74efdbc4-3eb6-4393-9f6f-2775f04d51ff tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:01.092957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-50082cfb-c75e-4536-93eb-d962361bbcf2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:01.100451 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-50082cfb-c75e-4536-93eb-d962361bbcf2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1218 microversion: 2.1 time: 0.203791 Nov 19 03:22:01.103987 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 185/353] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:00 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:01.152743 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-74efdbc4-3eb6-4393-9f6f-2775f04d51ff tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] HTTP exception thrown: Cannot 'attach_volume' instance b19ae39a-79ce-4adb-9ee4-595daa1a8d27 while it is in vm_state rescued Nov 19 03:22:01.160073 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-74efdbc4-3eb6-4393-9f6f-2775f04d51ff tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Returning 409 to user: Cannot 'attach_volume' instance b19ae39a-79ce-4adb-9ee4-595daa1a8d27 while it is in vm_state rescued {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:22:01.164119 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-74efdbc4-3eb6-4393-9f6f-2775f04d51ff tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "POST /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.159951 Nov 19 03:22:01.168193 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 169/354] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:22:00 2021] POST /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments => generated 152 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 19 03:22:01.177421 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-bf7ea6e9-4481-46c7-bdc9-ecdc44f5718c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:01.178017 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-bf7ea6e9-4481-46c7-bdc9-ecdc44f5718c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:01.194152 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bf7ea6e9-4481-46c7-bdc9-ecdc44f5718c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:01.194644 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bf7ea6e9-4481-46c7-bdc9-ecdc44f5718c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:01.195528 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bf7ea6e9-4481-46c7-bdc9-ecdc44f5718c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:01.195972 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bf7ea6e9-4481-46c7-bdc9-ecdc44f5718c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:01.438032 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-bf7ea6e9-4481-46c7-bdc9-ecdc44f5718c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "POST /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/action" status: 202 len: 0 microversion: 2.1 time: 0.264532 Nov 19 03:22:01.438840 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 186/355] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:22:01 2021] POST /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:01.447452 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-12ff419c-1319-4dd3-8942-84deafab9237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:01.448139 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-12ff419c-1319-4dd3-8942-84deafab9237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:01.458858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-12ff419c-1319-4dd3-8942-84deafab9237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:01.459280 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-12ff419c-1319-4dd3-8942-84deafab9237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:01.460123 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-12ff419c-1319-4dd3-8942-84deafab9237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:01.460667 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-12ff419c-1319-4dd3-8942-84deafab9237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:01.906867 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-cbdfffa4-b05c-49e3-a193-eb30be7f8b17 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:01.907891 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-cbdfffa4-b05c-49e3-a193-eb30be7f8b17 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:01.918910 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cbdfffa4-b05c-49e3-a193-eb30be7f8b17 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:01.919363 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cbdfffa4-b05c-49e3-a193-eb30be7f8b17 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:01.920170 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cbdfffa4-b05c-49e3-a193-eb30be7f8b17 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:01.920603 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cbdfffa4-b05c-49e3-a193-eb30be7f8b17 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:02.091016 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-cbdfffa4-b05c-49e3-a193-eb30be7f8b17 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.188768 Nov 19 03:22:02.091682 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 187/356] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:01 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:22:02.106156 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-139a77b7-9f60-4970-a02b-1190f8235acf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:02.107031 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-139a77b7-9f60-4970-a02b-1190f8235acf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:02.134269 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-139a77b7-9f60-4970-a02b-1190f8235acf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:02.134768 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-139a77b7-9f60-4970-a02b-1190f8235acf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:02.135602 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-139a77b7-9f60-4970-a02b-1190f8235acf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:02.136040 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-139a77b7-9f60-4970-a02b-1190f8235acf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:02.443795 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-139a77b7-9f60-4970-a02b-1190f8235acf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:02.458898 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-139a77b7-9f60-4970-a02b-1190f8235acf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1289 microversion: 2.1 time: 0.361676 Nov 19 03:22:02.462813 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 188/357] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:02 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1289 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:02.486261 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7ef33f87-e7ed-46ff-bb6e-047f07503cdd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:02.490293 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7ef33f87-e7ed-46ff-bb6e-047f07503cdd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:02.524065 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7ef33f87-e7ed-46ff-bb6e-047f07503cdd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:02.527045 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7ef33f87-e7ed-46ff-bb6e-047f07503cdd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:02.528167 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7ef33f87-e7ed-46ff-bb6e-047f07503cdd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:02.531511 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7ef33f87-e7ed-46ff-bb6e-047f07503cdd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:03.131628 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7ef33f87-e7ed-46ff-bb6e-047f07503cdd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:03.138990 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7ef33f87-e7ed-46ff-bb6e-047f07503cdd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1270 microversion: 2.1 time: 0.672517 Nov 19 03:22:03.140102 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 189/358] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:02 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1270 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:03.151205 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-58c0cd69-e073-4cbc-916d-0fe24d36ef50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:03.167919 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-58c0cd69-e073-4cbc-916d-0fe24d36ef50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:03.176830 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-58c0cd69-e073-4cbc-916d-0fe24d36ef50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:03.180824 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-58c0cd69-e073-4cbc-916d-0fe24d36ef50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:03.181881 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-58c0cd69-e073-4cbc-916d-0fe24d36ef50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:03.184675 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-58c0cd69-e073-4cbc-916d-0fe24d36ef50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:03.279004 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-12ff419c-1319-4dd3-8942-84deafab9237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:03.315389 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-12ff419c-1319-4dd3-8942-84deafab9237 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1511 microversion: 2.1 time: 1.871729 Nov 19 03:22:03.318191 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 170/359] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:01 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1511 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:03.331858 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-58c0cd69-e073-4cbc-916d-0fe24d36ef50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.184274 Nov 19 03:22:03.332505 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 190/360] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:03 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:03.478377 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-98d7e4bb-748c-4887-95c9-ee9a2f3dc8ac tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:03.479467 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-98d7e4bb-748c-4887-95c9-ee9a2f3dc8ac tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:03.497672 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98d7e4bb-748c-4887-95c9-ee9a2f3dc8ac tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:03.498312 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98d7e4bb-748c-4887-95c9-ee9a2f3dc8ac tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:03.499464 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98d7e4bb-748c-4887-95c9-ee9a2f3dc8ac tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:03.500026 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98d7e4bb-748c-4887-95c9-ee9a2f3dc8ac tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:03.873220 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-98d7e4bb-748c-4887-95c9-ee9a2f3dc8ac tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:03.884260 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-98d7e4bb-748c-4887-95c9-ee9a2f3dc8ac tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1295 microversion: 2.1 time: 0.409755 Nov 19 03:22:03.896550 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 171/361] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:03 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1295 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:04.158331 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-be082d81-8e5a-461d-bd2d-110b0c73c423 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:04.159206 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-be082d81-8e5a-461d-bd2d-110b0c73c423 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:04.179834 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-be082d81-8e5a-461d-bd2d-110b0c73c423 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:04.180675 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-be082d81-8e5a-461d-bd2d-110b0c73c423 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:04.181706 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-be082d81-8e5a-461d-bd2d-110b0c73c423 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:04.188093 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-be082d81-8e5a-461d-bd2d-110b0c73c423 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:04.336722 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-bbfc5118-09f0-4138-9453-77ed7095abf4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:04.337342 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-bbfc5118-09f0-4138-9453-77ed7095abf4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:04.350043 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bbfc5118-09f0-4138-9453-77ed7095abf4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:04.365170 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bbfc5118-09f0-4138-9453-77ed7095abf4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:04.366341 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bbfc5118-09f0-4138-9453-77ed7095abf4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:04.367927 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bbfc5118-09f0-4138-9453-77ed7095abf4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:04.411011 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-be082d81-8e5a-461d-bd2d-110b0c73c423 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:04.427413 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-be082d81-8e5a-461d-bd2d-110b0c73c423 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1276 microversion: 2.1 time: 0.273787 Nov 19 03:22:04.428673 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 191/362] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:04 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:04.446058 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f7f68cb8-8192-4a13-b82c-d7f6e4e8f258 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:04.457917 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f7f68cb8-8192-4a13-b82c-d7f6e4e8f258 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:04.477995 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f7f68cb8-8192-4a13-b82c-d7f6e4e8f258 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:04.478457 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f7f68cb8-8192-4a13-b82c-d7f6e4e8f258 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:04.484904 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f7f68cb8-8192-4a13-b82c-d7f6e4e8f258 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:04.485367 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f7f68cb8-8192-4a13-b82c-d7f6e4e8f258 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:04.658326 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f7f68cb8-8192-4a13-b82c-d7f6e4e8f258 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.227365 Nov 19 03:22:04.659014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 192/363] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:04 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:04.904409 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-cd613290-4929-4c23-9e48-ad2ef8c77f38 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:04.906265 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-cd613290-4929-4c23-9e48-ad2ef8c77f38 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:04.917420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cd613290-4929-4c23-9e48-ad2ef8c77f38 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:04.917871 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cd613290-4929-4c23-9e48-ad2ef8c77f38 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:04.925722 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cd613290-4929-4c23-9e48-ad2ef8c77f38 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:04.926184 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cd613290-4929-4c23-9e48-ad2ef8c77f38 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:05.041468 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-bbfc5118-09f0-4138-9453-77ed7095abf4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:05.051175 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-bbfc5118-09f0-4138-9453-77ed7095abf4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1511 microversion: 2.1 time: 0.718512 Nov 19 03:22:05.052378 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 172/364] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:04 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1511 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:22:05.287816 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-cd613290-4929-4c23-9e48-ad2ef8c77f38 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:05.303180 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-cd613290-4929-4c23-9e48-ad2ef8c77f38 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1295 microversion: 2.1 time: 0.403914 Nov 19 03:22:05.313940 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 193/365] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:04 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1295 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:05.445960 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3551920c-1b7e-4ae1-9f41-f0aa5dc6994e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:05.446700 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3551920c-1b7e-4ae1-9f41-f0aa5dc6994e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:05.461636 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3551920c-1b7e-4ae1-9f41-f0aa5dc6994e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:05.462082 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3551920c-1b7e-4ae1-9f41-f0aa5dc6994e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:05.462897 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3551920c-1b7e-4ae1-9f41-f0aa5dc6994e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:05.465612 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3551920c-1b7e-4ae1-9f41-f0aa5dc6994e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:05.671324 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a7de0db5-2c98-4fbb-8dd0-57e5a0e80bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:05.672415 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a7de0db5-2c98-4fbb-8dd0-57e5a0e80bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:05.682948 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a7de0db5-2c98-4fbb-8dd0-57e5a0e80bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:05.683402 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a7de0db5-2c98-4fbb-8dd0-57e5a0e80bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:05.684191 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a7de0db5-2c98-4fbb-8dd0-57e5a0e80bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:05.684616 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a7de0db5-2c98-4fbb-8dd0-57e5a0e80bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:05.857690 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a7de0db5-2c98-4fbb-8dd0-57e5a0e80bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.190187 Nov 19 03:22:05.858367 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 194/366] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:05 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:22:06.072660 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-61484185-6255-4ad2-b11b-8d74719649c8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:06.073363 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-61484185-6255-4ad2-b11b-8d74719649c8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:06.086690 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-61484185-6255-4ad2-b11b-8d74719649c8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:06.087151 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-61484185-6255-4ad2-b11b-8d74719649c8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:06.087945 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-61484185-6255-4ad2-b11b-8d74719649c8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:06.092165 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-61484185-6255-4ad2-b11b-8d74719649c8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:06.293886 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-3551920c-1b7e-4ae1-9f41-f0aa5dc6994e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:06.312205 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3551920c-1b7e-4ae1-9f41-f0aa5dc6994e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1318 microversion: 2.1 time: 0.870036 Nov 19 03:22:06.313184 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 173/367] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:05 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1318 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:06.334772 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-71700300-3169-4103-8358-9342f1dc67cb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:06.335585 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-71700300-3169-4103-8358-9342f1dc67cb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:06.346219 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-71700300-3169-4103-8358-9342f1dc67cb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:06.348942 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-71700300-3169-4103-8358-9342f1dc67cb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:06.349527 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-71700300-3169-4103-8358-9342f1dc67cb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:06.349978 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-71700300-3169-4103-8358-9342f1dc67cb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:06.931284 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-61484185-6255-4ad2-b11b-8d74719649c8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:06.946542 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-61484185-6255-4ad2-b11b-8d74719649c8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1511 microversion: 2.1 time: 0.878790 Nov 19 03:22:06.947934 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 195/368] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:06 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1511 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:22:06.961135 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-b0ce7109-3c3c-49cd-8be4-d95c638f9e29 req-4932016c-2d4e-4b50-8146-dead6751ec5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bbce071-8bbc-400a-b7f8-5e42b947e146", "tag": "ed5e2924-c9bb-46bb-87d4-7e2249b2a8b3"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:06.965060 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:22:06.965060 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:22:06.984299 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-b0ce7109-3c3c-49cd-8be4-d95c638f9e29 req-4932016c-2d4e-4b50-8146-dead6751ec5c service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:06.985369 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-b0ce7109-3c3c-49cd-8be4-d95c638f9e29 req-4932016c-2d4e-4b50-8146-dead6751ec5c service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:07.043304 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-b0ce7109-3c3c-49cd-8be4-d95c638f9e29 req-4932016c-2d4e-4b50-8146-dead6751ec5c service nova] Creating event network-changed:ed5e2924-c9bb-46bb-87d4-7e2249b2a8b3 for instance 1bbce071-8bbc-400a-b7f8-5e42b947e146 on hv-cinder-81803 Nov 19 03:22:07.071015 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-b0ce7109-3c3c-49cd-8be4-d95c638f9e29 req-4932016c-2d4e-4b50-8146-dead6751ec5c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107152 Nov 19 03:22:07.072012 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 196/369] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:22:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:22:07.077284 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-41d7b7ea-c5ff-40ad-b162-42ec2275cea9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:07.078338 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-41d7b7ea-c5ff-40ad-b162-42ec2275cea9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:07.116831 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-41d7b7ea-c5ff-40ad-b162-42ec2275cea9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:07.120815 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-41d7b7ea-c5ff-40ad-b162-42ec2275cea9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:07.121919 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-41d7b7ea-c5ff-40ad-b162-42ec2275cea9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:07.125171 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-41d7b7ea-c5ff-40ad-b162-42ec2275cea9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:07.360600 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-71700300-3169-4103-8358-9342f1dc67cb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:07.375336 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-71700300-3169-4103-8358-9342f1dc67cb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1363 microversion: 2.1 time: 1.051523 Nov 19 03:22:07.398050 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 174/370] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:06 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1363 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:22:07.411704 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f6036066-2ea1-42af-b801-baa5f5cc4373 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:07.413715 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f6036066-2ea1-42af-b801-baa5f5cc4373 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:07.438847 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f6036066-2ea1-42af-b801-baa5f5cc4373 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:07.439729 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f6036066-2ea1-42af-b801-baa5f5cc4373 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:07.441009 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f6036066-2ea1-42af-b801-baa5f5cc4373 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:07.441411 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-41d7b7ea-c5ff-40ad-b162-42ec2275cea9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.367599 Nov 19 03:22:07.441876 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f6036066-2ea1-42af-b801-baa5f5cc4373 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:07.445552 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 197/371] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:07 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:07.921620 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-f6036066-2ea1-42af-b801-baa5f5cc4373 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:07.935269 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f6036066-2ea1-42af-b801-baa5f5cc4373 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1318 microversion: 2.1 time: 0.533278 Nov 19 03:22:07.938265 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 175/372] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:07 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:07.965294 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-65a3181e-9a84-4491-b8be-7095b45b1489 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:07.965999 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-65a3181e-9a84-4491-b8be-7095b45b1489 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:07.992262 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-65a3181e-9a84-4491-b8be-7095b45b1489 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:07.993218 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-65a3181e-9a84-4491-b8be-7095b45b1489 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:07.995230 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-65a3181e-9a84-4491-b8be-7095b45b1489 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:07.999690 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-65a3181e-9a84-4491-b8be-7095b45b1489 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:08.355822 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-65a3181e-9a84-4491-b8be-7095b45b1489 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:08.382754 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-65a3181e-9a84-4491-b8be-7095b45b1489 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1517 microversion: 2.1 time: 0.419122 Nov 19 03:22:08.383357 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 198/373] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:07 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1517 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:08.399947 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6abc4e07-2c2a-4b4b-b5b1-3ee1a0ba5dfd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:08.402088 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6abc4e07-2c2a-4b4b-b5b1-3ee1a0ba5dfd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:08.450159 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6abc4e07-2c2a-4b4b-b5b1-3ee1a0ba5dfd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:08.453745 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6abc4e07-2c2a-4b4b-b5b1-3ee1a0ba5dfd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:08.457515 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-66d3f406-fdad-4972-933c-496ee864b226 req-f8e8ef00-364a-431b-9f4a-f8f759652c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5741fba7-f551-445e-833f-303eca2c8dae", "tag": "3e4fe64e-0ede-4166-9e29-1ae375f51703"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:08.473071 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6abc4e07-2c2a-4b4b-b5b1-3ee1a0ba5dfd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:08.476270 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:22:08.476270 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:22:08.476858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6abc4e07-2c2a-4b4b-b5b1-3ee1a0ba5dfd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:08.525458 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-66d3f406-fdad-4972-933c-496ee864b226 req-f8e8ef00-364a-431b-9f4a-f8f759652c29 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:08.536964 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-66d3f406-fdad-4972-933c-496ee864b226 req-f8e8ef00-364a-431b-9f4a-f8f759652c29 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:08.594961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-66d3f406-fdad-4972-933c-496ee864b226 req-f8e8ef00-364a-431b-9f4a-f8f759652c29 service nova] Creating event network-changed:3e4fe64e-0ede-4166-9e29-1ae375f51703 for instance 5741fba7-f551-445e-833f-303eca2c8dae on hv-cinder-81803 Nov 19 03:22:08.614183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-66d3f406-fdad-4972-933c-496ee864b226 req-f8e8ef00-364a-431b-9f4a-f8f759652c29 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169369 Nov 19 03:22:08.620319 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 199/374] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:22:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:22:08.643865 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ce5a2638-f8dd-4864-9035-c44ee5f6f1f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:08.652172 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ce5a2638-f8dd-4864-9035-c44ee5f6f1f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:08.672991 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ce5a2638-f8dd-4864-9035-c44ee5f6f1f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:08.673778 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ce5a2638-f8dd-4864-9035-c44ee5f6f1f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:08.674837 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ce5a2638-f8dd-4864-9035-c44ee5f6f1f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:08.675552 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ce5a2638-f8dd-4864-9035-c44ee5f6f1f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:09.048155 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ce5a2638-f8dd-4864-9035-c44ee5f6f1f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.426360 Nov 19 03:22:09.052315 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 200/375] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:08 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:09.064279 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-df93b9f5-2376-4c9a-a660-24bc77a12474 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:09.066063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-df93b9f5-2376-4c9a-a660-24bc77a12474 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:09.101092 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-df93b9f5-2376-4c9a-a660-24bc77a12474 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:09.102451 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-df93b9f5-2376-4c9a-a660-24bc77a12474 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:09.104128 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-df93b9f5-2376-4c9a-a660-24bc77a12474 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:09.106640 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-df93b9f5-2376-4c9a-a660-24bc77a12474 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:09.874802 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-6abc4e07-2c2a-4b4b-b5b1-3ee1a0ba5dfd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:09.884144 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6abc4e07-2c2a-4b4b-b5b1-3ee1a0ba5dfd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1363 microversion: 2.1 time: 1.491525 Nov 19 03:22:09.899984 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 176/376] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:08 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1363 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:10.064958 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-898f73ad-9945-45d7-b8ed-9f016fad0cab tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:10.066091 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-898f73ad-9945-45d7-b8ed-9f016fad0cab tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:10.089135 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-898f73ad-9945-45d7-b8ed-9f016fad0cab tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:10.089875 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-898f73ad-9945-45d7-b8ed-9f016fad0cab tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:10.090927 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-898f73ad-9945-45d7-b8ed-9f016fad0cab tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:10.091424 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-898f73ad-9945-45d7-b8ed-9f016fad0cab tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:10.191211 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-df93b9f5-2376-4c9a-a660-24bc77a12474 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:10.215495 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-df93b9f5-2376-4c9a-a660-24bc77a12474 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1318 microversion: 2.1 time: 1.154533 Nov 19 03:22:10.215495 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 201/377] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:09 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1318 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:10.215495 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-51d32569-2335-4f9c-8bb7-859171db1a25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:10.215495 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-51d32569-2335-4f9c-8bb7-859171db1a25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:10.230732 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51d32569-2335-4f9c-8bb7-859171db1a25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:10.231193 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51d32569-2335-4f9c-8bb7-859171db1a25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:10.231992 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51d32569-2335-4f9c-8bb7-859171db1a25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:10.232444 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51d32569-2335-4f9c-8bb7-859171db1a25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:10.488781 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-51d32569-2335-4f9c-8bb7-859171db1a25 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.281719 Nov 19 03:22:10.489235 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-898f73ad-9945-45d7-b8ed-9f016fad0cab tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:10.490702 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 202/378] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:10 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:10.512068 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-898f73ad-9945-45d7-b8ed-9f016fad0cab tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1517 microversion: 2.1 time: 0.454721 Nov 19 03:22:10.512893 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 177/379] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:10 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1517 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:10.534793 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4e733138-c933-471d-af2f-495cb8aa6278 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb3dae86-eb8b-45c3-bfac-1a616aa85dc0"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:10.543558 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4e733138-c933-471d-af2f-495cb8aa6278 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:10.562430 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e733138-c933-471d-af2f-495cb8aa6278 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:10.563564 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e733138-c933-471d-af2f-495cb8aa6278 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:10.564797 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e733138-c933-471d-af2f-495cb8aa6278 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:10.567839 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e733138-c933-471d-af2f-495cb8aa6278 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:10.903503 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-57a8c93f-fc16-48bf-8f41-bb6167b1c29b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:10.904674 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-57a8c93f-fc16-48bf-8f41-bb6167b1c29b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:10.927017 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-57a8c93f-fc16-48bf-8f41-bb6167b1c29b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:10.927731 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-57a8c93f-fc16-48bf-8f41-bb6167b1c29b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:10.928706 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-57a8c93f-fc16-48bf-8f41-bb6167b1c29b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:10.929778 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-57a8c93f-fc16-48bf-8f41-bb6167b1c29b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:11.087476 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4e733138-c933-471d-af2f-495cb8aa6278 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "POST /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.558206 Nov 19 03:22:11.094559 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 203/380] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:22:10 2021] POST /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments => generated 194 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:22:11.232110 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ba28d3df-1de2-401a-8e54-a95d782f5ce6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:11.232877 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ba28d3df-1de2-401a-8e54-a95d782f5ce6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:11.250266 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ba28d3df-1de2-401a-8e54-a95d782f5ce6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:11.251210 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ba28d3df-1de2-401a-8e54-a95d782f5ce6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:11.263770 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ba28d3df-1de2-401a-8e54-a95d782f5ce6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:11.267481 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ba28d3df-1de2-401a-8e54-a95d782f5ce6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:11.298226 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-57a8c93f-fc16-48bf-8f41-bb6167b1c29b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:11.308811 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-57a8c93f-fc16-48bf-8f41-bb6167b1c29b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1363 microversion: 2.1 time: 0.409675 Nov 19 03:22:11.320573 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 178/381] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:10 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1363 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:22:11.501244 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0a793cde-0c1f-45d3-9fa2-03c5bb7a9213 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:11.502244 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0a793cde-0c1f-45d3-9fa2-03c5bb7a9213 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:11.511150 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a793cde-0c1f-45d3-9fa2-03c5bb7a9213 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:11.511516 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a793cde-0c1f-45d3-9fa2-03c5bb7a9213 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:11.512392 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a793cde-0c1f-45d3-9fa2-03c5bb7a9213 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:11.512827 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a793cde-0c1f-45d3-9fa2-03c5bb7a9213 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:11.550405 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ba28d3df-1de2-401a-8e54-a95d782f5ce6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:11.561182 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ba28d3df-1de2-401a-8e54-a95d782f5ce6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1318 microversion: 2.1 time: 0.340660 Nov 19 03:22:11.570986 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 204/382] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:11 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:22:11.668730 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0a793cde-0c1f-45d3-9fa2-03c5bb7a9213 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.168475 Nov 19 03:22:11.669346 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 179/383] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:11 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:22:12.338839 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-699f5938-b43d-44e0-b72a-0eaec9c2598c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:12.339647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-699f5938-b43d-44e0-b72a-0eaec9c2598c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:12.351426 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-699f5938-b43d-44e0-b72a-0eaec9c2598c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:12.352219 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-699f5938-b43d-44e0-b72a-0eaec9c2598c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:12.352898 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-699f5938-b43d-44e0-b72a-0eaec9c2598c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:12.353730 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-699f5938-b43d-44e0-b72a-0eaec9c2598c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:12.547990 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-699f5938-b43d-44e0-b72a-0eaec9c2598c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:12.556160 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-699f5938-b43d-44e0-b72a-0eaec9c2598c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1363 microversion: 2.1 time: 0.220847 Nov 19 03:22:12.579482 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ed5e2755-0163-4c2d-9302-dc3c6f51e672 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:12.580742 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ed5e2755-0163-4c2d-9302-dc3c6f51e672 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:12.583418 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 205/384] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:12 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:12.599349 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed5e2755-0163-4c2d-9302-dc3c6f51e672 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:12.599885 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed5e2755-0163-4c2d-9302-dc3c6f51e672 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:12.600898 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed5e2755-0163-4c2d-9302-dc3c6f51e672 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:12.608289 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed5e2755-0163-4c2d-9302-dc3c6f51e672 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:12.680445 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-26e12198-cd40-430b-8b6e-a68bc48f7315 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:12.681632 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-26e12198-cd40-430b-8b6e-a68bc48f7315 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:12.690412 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-26e12198-cd40-430b-8b6e-a68bc48f7315 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:12.691042 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-26e12198-cd40-430b-8b6e-a68bc48f7315 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:12.692521 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-26e12198-cd40-430b-8b6e-a68bc48f7315 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:12.693037 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-26e12198-cd40-430b-8b6e-a68bc48f7315 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:12.816168 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ed5e2755-0163-4c2d-9302-dc3c6f51e672 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:12.818794 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-26e12198-cd40-430b-8b6e-a68bc48f7315 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.139662 Nov 19 03:22:12.824229 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 206/385] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:12 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:22:12.824480 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ed5e2755-0163-4c2d-9302-dc3c6f51e672 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1318 microversion: 2.1 time: 0.250116 Nov 19 03:22:12.826391 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 180/386] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:12 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:13.578996 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-855c9db4-308a-47d6-8955-36d869678a20 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:13.579604 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-855c9db4-308a-47d6-8955-36d869678a20 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:13.586362 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-855c9db4-308a-47d6-8955-36d869678a20 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:13.586849 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-855c9db4-308a-47d6-8955-36d869678a20 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:13.587637 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-855c9db4-308a-47d6-8955-36d869678a20 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:13.588063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-855c9db4-308a-47d6-8955-36d869678a20 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:13.809642 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-855c9db4-308a-47d6-8955-36d869678a20 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:13.822293 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-855c9db4-308a-47d6-8955-36d869678a20 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1363 microversion: 2.1 time: 0.247543 Nov 19 03:22:13.823213 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 207/387] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:13 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:13.833247 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f5b6e31b-21a0-4b08-a0b1-595732b1a314 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:13.834958 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f5b6e31b-21a0-4b08-a0b1-595732b1a314 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:13.848321 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f5b6e31b-21a0-4b08-a0b1-595732b1a314 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:13.848767 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f5b6e31b-21a0-4b08-a0b1-595732b1a314 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:13.849933 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-20232430-c08f-42e4-9bf9-56d866d187ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:13.850570 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-20232430-c08f-42e4-9bf9-56d866d187ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:13.852826 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f5b6e31b-21a0-4b08-a0b1-595732b1a314 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:13.853496 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f5b6e31b-21a0-4b08-a0b1-595732b1a314 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:13.867914 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-20232430-c08f-42e4-9bf9-56d866d187ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:13.868637 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-20232430-c08f-42e4-9bf9-56d866d187ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:13.869612 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-20232430-c08f-42e4-9bf9-56d866d187ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:13.870354 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-20232430-c08f-42e4-9bf9-56d866d187ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:13.968581 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f5b6e31b-21a0-4b08-a0b1-595732b1a314 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.139843 Nov 19 03:22:13.969242 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 181/388] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:13 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:14.024014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-20232430-c08f-42e4-9bf9-56d866d187ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:14.036443 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-20232430-c08f-42e4-9bf9-56d866d187ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1318 microversion: 2.1 time: 0.193796 Nov 19 03:22:14.037133 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 208/389] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:13 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:14.840929 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5d21214d-30f4-4249-8c32-93aa13243a12 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:14.842407 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5d21214d-30f4-4249-8c32-93aa13243a12 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:14.850297 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5d21214d-30f4-4249-8c32-93aa13243a12 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:14.851228 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5d21214d-30f4-4249-8c32-93aa13243a12 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:14.851901 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5d21214d-30f4-4249-8c32-93aa13243a12 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:14.854221 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5d21214d-30f4-4249-8c32-93aa13243a12 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:15.001850 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9b758da3-4207-461b-ba8d-b72d607e9a30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:15.003980 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9b758da3-4207-461b-ba8d-b72d607e9a30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:15.018133 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9b758da3-4207-461b-ba8d-b72d607e9a30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:15.018948 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9b758da3-4207-461b-ba8d-b72d607e9a30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:15.019915 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9b758da3-4207-461b-ba8d-b72d607e9a30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:15.022084 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9b758da3-4207-461b-ba8d-b72d607e9a30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:15.035811 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5d21214d-30f4-4249-8c32-93aa13243a12 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:15.050095 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5d21214d-30f4-4249-8c32-93aa13243a12 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1363 microversion: 2.1 time: 0.214410 Nov 19 03:22:15.062808 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 182/390] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:14 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:15.075298 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f21426f5-ab87-481e-8cf8-5c5a775c5f12 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:15.077907 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f21426f5-ab87-481e-8cf8-5c5a775c5f12 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:15.085012 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f21426f5-ab87-481e-8cf8-5c5a775c5f12 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:15.085735 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f21426f5-ab87-481e-8cf8-5c5a775c5f12 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:15.086762 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f21426f5-ab87-481e-8cf8-5c5a775c5f12 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:15.087422 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f21426f5-ab87-481e-8cf8-5c5a775c5f12 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:15.133328 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9b758da3-4207-461b-ba8d-b72d607e9a30 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.155795 Nov 19 03:22:15.143955 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 209/391] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:14 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:15.298114 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-f21426f5-ab87-481e-8cf8-5c5a775c5f12 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:15.308511 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f21426f5-ab87-481e-8cf8-5c5a775c5f12 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1318 microversion: 2.1 time: 0.242895 Nov 19 03:22:15.309869 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 183/392] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:15 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:15.380499 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-38f0f0e6-e3fc-4a40-bda0-aa40b10f3bbe req-fee43bb0-1bb7-45e3-8901-8195a687b81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bbce071-8bbc-400a-b7f8-5e42b947e146", "name": "network-vif-plugged", "status": "completed", "tag": "ed5e2924-c9bb-46bb-87d4-7e2249b2a8b3"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:15.382860 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:22:15.382860 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:22:15.394499 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-38f0f0e6-e3fc-4a40-bda0-aa40b10f3bbe req-fee43bb0-1bb7-45e3-8901-8195a687b81e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:15.395477 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-38f0f0e6-e3fc-4a40-bda0-aa40b10f3bbe req-fee43bb0-1bb7-45e3-8901-8195a687b81e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:15.414811 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-38f0f0e6-e3fc-4a40-bda0-aa40b10f3bbe req-fee43bb0-1bb7-45e3-8901-8195a687b81e service nova] Creating event network-vif-plugged:ed5e2924-c9bb-46bb-87d4-7e2249b2a8b3 for instance 1bbce071-8bbc-400a-b7f8-5e42b947e146 on hv-cinder-81803 Nov 19 03:22:15.422685 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-38f0f0e6-e3fc-4a40-bda0-aa40b10f3bbe req-fee43bb0-1bb7-45e3-8901-8195a687b81e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049207 Nov 19 03:22:15.423684 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 210/393] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:22:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:22:16.068969 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6315f944-d055-4e72-9d3c-448cc5ef41cf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:16.069641 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6315f944-d055-4e72-9d3c-448cc5ef41cf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:16.081355 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6315f944-d055-4e72-9d3c-448cc5ef41cf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:16.081810 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6315f944-d055-4e72-9d3c-448cc5ef41cf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:16.082643 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6315f944-d055-4e72-9d3c-448cc5ef41cf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:16.083974 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6315f944-d055-4e72-9d3c-448cc5ef41cf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:16.146088 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3778a0f9-3e49-442e-b2f5-d7bab1976dce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:16.147311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3778a0f9-3e49-442e-b2f5-d7bab1976dce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:16.160042 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3778a0f9-3e49-442e-b2f5-d7bab1976dce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:16.163385 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3778a0f9-3e49-442e-b2f5-d7bab1976dce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:16.164415 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3778a0f9-3e49-442e-b2f5-d7bab1976dce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:16.165014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3778a0f9-3e49-442e-b2f5-d7bab1976dce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:16.253055 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-6315f944-d055-4e72-9d3c-448cc5ef41cf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:16.270895 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6315f944-d055-4e72-9d3c-448cc5ef41cf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1363 microversion: 2.1 time: 0.205468 Nov 19 03:22:16.271468 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 184/394] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:16 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:16.277415 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3778a0f9-3e49-442e-b2f5-d7bab1976dce tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.135475 Nov 19 03:22:16.278048 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 211/395] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:16 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:16.328809 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6e143309-8c2b-416e-b414-9b74f1a80142 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:16.329410 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6e143309-8c2b-416e-b414-9b74f1a80142 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:16.335743 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e143309-8c2b-416e-b414-9b74f1a80142 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:16.336968 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e143309-8c2b-416e-b414-9b74f1a80142 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:16.337963 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e143309-8c2b-416e-b414-9b74f1a80142 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:16.338815 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e143309-8c2b-416e-b414-9b74f1a80142 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:16.498142 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-6e143309-8c2b-416e-b414-9b74f1a80142 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:16.505796 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6e143309-8c2b-416e-b414-9b74f1a80142 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1318 microversion: 2.1 time: 0.184178 Nov 19 03:22:16.516503 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 185/396] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:16 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:17.288970 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5201f7ef-97e0-4629-954d-4cfa84d0a607 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:17.289633 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7521cdee-3d65-4eb1-a5de-1001cc910d3e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:17.290002 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5201f7ef-97e0-4629-954d-4cfa84d0a607 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:17.290094 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7521cdee-3d65-4eb1-a5de-1001cc910d3e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:17.297502 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7521cdee-3d65-4eb1-a5de-1001cc910d3e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:17.297817 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5201f7ef-97e0-4629-954d-4cfa84d0a607 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:17.298213 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5201f7ef-97e0-4629-954d-4cfa84d0a607 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:17.298724 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7521cdee-3d65-4eb1-a5de-1001cc910d3e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:17.299090 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5201f7ef-97e0-4629-954d-4cfa84d0a607 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:17.299518 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5201f7ef-97e0-4629-954d-4cfa84d0a607 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:17.300162 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7521cdee-3d65-4eb1-a5de-1001cc910d3e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:17.300793 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7521cdee-3d65-4eb1-a5de-1001cc910d3e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:17.482988 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7521cdee-3d65-4eb1-a5de-1001cc910d3e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:17.492748 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7521cdee-3d65-4eb1-a5de-1001cc910d3e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1363 microversion: 2.1 time: 0.207245 Nov 19 03:22:17.493332 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 212/397] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:17 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:17.522900 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-58cb0446-6d70-48b2-a4d7-231b3ee5cf1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:17.523503 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-58cb0446-6d70-48b2-a4d7-231b3ee5cf1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:17.534546 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-58cb0446-6d70-48b2-a4d7-231b3ee5cf1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:17.535747 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-58cb0446-6d70-48b2-a4d7-231b3ee5cf1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:17.536574 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-58cb0446-6d70-48b2-a4d7-231b3ee5cf1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:17.539676 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-58cb0446-6d70-48b2-a4d7-231b3ee5cf1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:17.627436 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5201f7ef-97e0-4629-954d-4cfa84d0a607 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.341881 Nov 19 03:22:17.628059 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 186/398] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:17 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:17.735743 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-58cb0446-6d70-48b2-a4d7-231b3ee5cf1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:17.743290 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-58cb0446-6d70-48b2-a4d7-231b3ee5cf1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1318 microversion: 2.1 time: 0.224060 Nov 19 03:22:17.746268 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 213/399] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:17 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:18.509877 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-acc62e2e-0aac-4f1c-befe-956222e473f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:18.510591 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-acc62e2e-0aac-4f1c-befe-956222e473f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:18.521049 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-acc62e2e-0aac-4f1c-befe-956222e473f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:18.521452 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-acc62e2e-0aac-4f1c-befe-956222e473f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:18.522262 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-acc62e2e-0aac-4f1c-befe-956222e473f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:18.522704 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-acc62e2e-0aac-4f1c-befe-956222e473f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:18.639163 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-552293c1-e66c-4139-ad1a-72db9c27ee9e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:18.641251 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-552293c1-e66c-4139-ad1a-72db9c27ee9e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:18.654132 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-552293c1-e66c-4139-ad1a-72db9c27ee9e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:18.656678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-552293c1-e66c-4139-ad1a-72db9c27ee9e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:18.657648 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-552293c1-e66c-4139-ad1a-72db9c27ee9e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:18.659096 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-552293c1-e66c-4139-ad1a-72db9c27ee9e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:18.734196 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-acc62e2e-0aac-4f1c-befe-956222e473f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:18.741933 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-acc62e2e-0aac-4f1c-befe-956222e473f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1363 microversion: 2.1 time: 0.236296 Nov 19 03:22:18.748654 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 187/400] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:18 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:18.760300 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c27235ad-98eb-4587-aa6d-d5692e6540bf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:18.761139 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c27235ad-98eb-4587-aa6d-d5692e6540bf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:18.772527 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c27235ad-98eb-4587-aa6d-d5692e6540bf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:18.772831 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c27235ad-98eb-4587-aa6d-d5692e6540bf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:18.773619 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c27235ad-98eb-4587-aa6d-d5692e6540bf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:18.774044 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c27235ad-98eb-4587-aa6d-d5692e6540bf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:18.798727 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-552293c1-e66c-4139-ad1a-72db9c27ee9e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.163118 Nov 19 03:22:18.802818 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 214/401] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:18 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:22:18.826105 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-493e5f1d-185d-4752-a352-c1b14d2269d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:18.828274 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-493e5f1d-185d-4752-a352-c1b14d2269d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:18.841517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-493e5f1d-185d-4752-a352-c1b14d2269d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:18.843449 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-493e5f1d-185d-4752-a352-c1b14d2269d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:18.844405 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-493e5f1d-185d-4752-a352-c1b14d2269d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:18.846633 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-493e5f1d-185d-4752-a352-c1b14d2269d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:18.890731 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-493e5f1d-185d-4752-a352-c1b14d2269d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'flavor' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:22:18.963942 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c27235ad-98eb-4587-aa6d-d5692e6540bf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:18.974124 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c27235ad-98eb-4587-aa6d-d5692e6540bf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1509 microversion: 2.1 time: 0.217636 Nov 19 03:22:18.976337 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 188/402] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:18 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:22:19.087277 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-493e5f1d-185d-4752-a352-c1b14d2269d0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "POST /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/action" status: 200 len: 32 microversion: 2.1 time: 0.265051 Nov 19 03:22:19.094851 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 215/403] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:22:18 2021] POST /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/action => generated 32 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:22:19.102627 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7bc4ddd9-de70-4689-848a-b05187cbd757 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:19.103238 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7bc4ddd9-de70-4689-848a-b05187cbd757 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:19.113344 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7bc4ddd9-de70-4689-848a-b05187cbd757 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:19.121436 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7bc4ddd9-de70-4689-848a-b05187cbd757 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:19.125576 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7bc4ddd9-de70-4689-848a-b05187cbd757 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:19.129374 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7bc4ddd9-de70-4689-848a-b05187cbd757 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:19.498328 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-4b86eecc-c3e5-4c5b-ac21-282476bd5f29 req-62e49330-9daa-4ae8-9144-0562530c22de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5741fba7-f551-445e-833f-303eca2c8dae", "name": "network-vif-plugged", "status": "completed", "tag": "3e4fe64e-0ede-4166-9e29-1ae375f51703"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:19.504482 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:22:19.504482 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:22:19.549779 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-7bc4ddd9-de70-4689-848a-b05187cbd757 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:19.557304 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-4b86eecc-c3e5-4c5b-ac21-282476bd5f29 req-62e49330-9daa-4ae8-9144-0562530c22de service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:19.557748 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-4b86eecc-c3e5-4c5b-ac21-282476bd5f29 req-62e49330-9daa-4ae8-9144-0562530c22de service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:19.558014 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7bc4ddd9-de70-4689-848a-b05187cbd757 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.464728 Nov 19 03:22:19.567266 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 189/404] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:19 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:22:19.595365 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-4b86eecc-c3e5-4c5b-ac21-282476bd5f29 req-62e49330-9daa-4ae8-9144-0562530c22de service nova] Creating event network-vif-plugged:3e4fe64e-0ede-4166-9e29-1ae375f51703 for instance 5741fba7-f551-445e-833f-303eca2c8dae on hv-cinder-81803 Nov 19 03:22:19.613950 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-4b86eecc-c3e5-4c5b-ac21-282476bd5f29 req-62e49330-9daa-4ae8-9144-0562530c22de service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129371 Nov 19 03:22:19.616929 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 216/405] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:22:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:22:19.760437 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-51bbee65-cb5b-4ac5-aa37-a79705848802 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:19.761308 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-51bbee65-cb5b-4ac5-aa37-a79705848802 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:19.776600 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51bbee65-cb5b-4ac5-aa37-a79705848802 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:19.778580 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51bbee65-cb5b-4ac5-aa37-a79705848802 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:19.779600 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51bbee65-cb5b-4ac5-aa37-a79705848802 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:19.781469 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51bbee65-cb5b-4ac5-aa37-a79705848802 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:19.811963 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d43dc163-b4cf-43ab-972b-94799f6cf9c6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:19.814048 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d43dc163-b4cf-43ab-972b-94799f6cf9c6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:19.834095 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d43dc163-b4cf-43ab-972b-94799f6cf9c6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:19.834585 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d43dc163-b4cf-43ab-972b-94799f6cf9c6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:19.835387 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d43dc163-b4cf-43ab-972b-94799f6cf9c6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:19.835823 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d43dc163-b4cf-43ab-972b-94799f6cf9c6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:19.959971 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d43dc163-b4cf-43ab-972b-94799f6cf9c6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.152898 Nov 19 03:22:19.960608 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 217/406] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:19 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:22:20.106501 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-51bbee65-cb5b-4ac5-aa37-a79705848802 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:20.120096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-51bbee65-cb5b-4ac5-aa37-a79705848802 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1363 microversion: 2.1 time: 0.363239 Nov 19 03:22:20.126691 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 190/407] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:19 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:20.360542 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a7ca2085-16c1-4b19-8068-9e225b5bcf63 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Action: 'create', calling method: .version_select at 0x7f845ab025e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1490067239"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:20.380919 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-a7ca2085-16c1-4b19-8068-9e225b5bcf63 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Getting quotas for project c8cae9fa88fe44aa9fb69e4e206b3e61. Resources: {'key_pairs'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:22:20.384638 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-a7ca2085-16c1-4b19-8068-9e225b5bcf63 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Getting quotas for user 0ccf75eb68e24f158f08484a003a1795 and project c8cae9fa88fe44aa9fb69e4e206b3e61. Resources: {'key_pairs'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:22:20.579994 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-099f6553-f621-41c7-9c10-fbf5fdb941ee tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:20.580728 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-099f6553-f621-41c7-9c10-fbf5fdb941ee tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:20.587047 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-099f6553-f621-41c7-9c10-fbf5fdb941ee tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:20.588288 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-099f6553-f621-41c7-9c10-fbf5fdb941ee tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:20.589483 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-099f6553-f621-41c7-9c10-fbf5fdb941ee tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:20.590072 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-099f6553-f621-41c7-9c10-fbf5fdb941ee tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:20.761838 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-a7ca2085-16c1-4b19-8068-9e225b5bcf63 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Getting quotas for project c8cae9fa88fe44aa9fb69e4e206b3e61. Resources: {'key_pairs'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:22:20.767242 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-099f6553-f621-41c7-9c10-fbf5fdb941ee tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:20.768434 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-a7ca2085-16c1-4b19-8068-9e225b5bcf63 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Getting quotas for user 0ccf75eb68e24f158f08484a003a1795 and project c8cae9fa88fe44aa9fb69e4e206b3e61. Resources: {'key_pairs'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:22:20.776073 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-099f6553-f621-41c7-9c10-fbf5fdb941ee tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.200428 Nov 19 03:22:20.776640 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 191/408] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:20 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:22:20.781723 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-68254d01-83cd-4251-80a7-2e749220f041 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9be4470-ab3f-4943-a794-5b605096220a"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:20.782998 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-68254d01-83cd-4251-80a7-2e749220f041 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:20.787849 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a7ca2085-16c1-4b19-8068-9e225b5bcf63 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.431227 Nov 19 03:22:20.788648 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 218/409] 10.222.0.47 () {60 vars in 1157 bytes} [Fri Nov 19 03:22:20 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:20.789905 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-68254d01-83cd-4251-80a7-2e749220f041 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:20.790335 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-68254d01-83cd-4251-80a7-2e749220f041 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:20.791528 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-68254d01-83cd-4251-80a7-2e749220f041 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:20.791633 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-68254d01-83cd-4251-80a7-2e749220f041 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:20.900910 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1852781119", "imageRef": "1e0cfab1-af1c-4331-89de-2f9c0d6be23a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1490067239", "networks": [{"uuid": "96107137-2387-4a29-be95-3b64cadd1d37"}]}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:20.953647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.network.neutron [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] validate_networks() for [('96107137-2387-4a29-be95-3b64cadd1d37', None, None, None, None, None)] {{(pid=116065) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:22:21.104030 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-68254d01-83cd-4251-80a7-2e749220f041 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "POST /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325391 Nov 19 03:22:21.104832 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 192/410] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:22:20 2021] POST /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:22:21.114183 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3f1817eb-5443-4f9a-b67e-721c9b00cc35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:21.115822 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3f1817eb-5443-4f9a-b67e-721c9b00cc35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:21.124396 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3f1817eb-5443-4f9a-b67e-721c9b00cc35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:21.125427 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3f1817eb-5443-4f9a-b67e-721c9b00cc35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:21.126585 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3f1817eb-5443-4f9a-b67e-721c9b00cc35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:21.127102 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3f1817eb-5443-4f9a-b67e-721c9b00cc35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:21.250615 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3f1817eb-5443-4f9a-b67e-721c9b00cc35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.142385 Nov 19 03:22:21.251262 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 193/411] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:21 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:21.256268 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-be6fb1b4-6ddd-4dd8-9301-8e9eb44ec7b9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:21.257142 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-be6fb1b4-6ddd-4dd8-9301-8e9eb44ec7b9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:21.264003 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be6fb1b4-6ddd-4dd8-9301-8e9eb44ec7b9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:21.264518 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be6fb1b4-6ddd-4dd8-9301-8e9eb44ec7b9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:21.265650 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be6fb1b4-6ddd-4dd8-9301-8e9eb44ec7b9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:21.266088 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be6fb1b4-6ddd-4dd8-9301-8e9eb44ec7b9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:21.411143 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Flavor limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:22:21.411561 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Image limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:22:21.412024 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Flavor pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:22:21.412421 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Image pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:22:21.412849 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:22:21.422086 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:21.422717 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:21.423555 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:21.424008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:21.440067 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Getting quotas for project c8cae9fa88fe44aa9fb69e4e206b3e61. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:22:21.443826 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Getting quotas for user 0ccf75eb68e24f158f08484a003a1795 and project c8cae9fa88fe44aa9fb69e4e206b3e61. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:22:21.455005 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-be6fb1b4-6ddd-4dd8-9301-8e9eb44ec7b9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:21.455186 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Going to run 1 instances... {{(pid=116065) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:22:21.457908 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e0cfab1-af1c-4331-89de-2f9c0d6be23a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:22:21.464078 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-be6fb1b4-6ddd-4dd8-9301-8e9eb44ec7b9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1363 microversion: 2.1 time: 0.211092 Nov 19 03:22:21.464650 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 194/412] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:21 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:21.503336 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ffb15d5e-9586-4368-bc50-bb3d305bfd33 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606938 Nov 19 03:22:21.503966 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 219/413] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:22:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:22:21.513478 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-01bf4a17-e752-40a3-8771-a13a6e048853 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:21.514082 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-01bf4a17-e752-40a3-8771-a13a6e048853 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:21.566713 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-01bf4a17-e752-40a3-8771-a13a6e048853 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:21.573921 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-01bf4a17-e752-40a3-8771-a13a6e048853 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1259 microversion: 2.1 time: 0.064031 Nov 19 03:22:21.574493 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 195/414] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:21 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1259 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:21.793551 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-45393487-85a1-4284-9344-bf9b16f5b246 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:21.794213 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-45393487-85a1-4284-9344-bf9b16f5b246 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:21.801945 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-45393487-85a1-4284-9344-bf9b16f5b246 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:21.802386 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-45393487-85a1-4284-9344-bf9b16f5b246 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:21.803213 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-45393487-85a1-4284-9344-bf9b16f5b246 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:21.803646 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-45393487-85a1-4284-9344-bf9b16f5b246 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:21.946646 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-45393487-85a1-4284-9344-bf9b16f5b246 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:21.955092 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-45393487-85a1-4284-9344-bf9b16f5b246 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.165637 Nov 19 03:22:21.955643 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 220/415] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:21 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:22.261757 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3639a3c0-aa13-499a-b7db-d4df7d41b49d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:22.262767 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3639a3c0-aa13-499a-b7db-d4df7d41b49d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:22.269208 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3639a3c0-aa13-499a-b7db-d4df7d41b49d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:22.269743 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3639a3c0-aa13-499a-b7db-d4df7d41b49d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:22.270626 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3639a3c0-aa13-499a-b7db-d4df7d41b49d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:22.271064 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3639a3c0-aa13-499a-b7db-d4df7d41b49d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:22.434955 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3639a3c0-aa13-499a-b7db-d4df7d41b49d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.176708 Nov 19 03:22:22.435600 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 196/416] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:22 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:22.480866 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6d7f51c0-bab9-4fc3-a53a-c3755404b4ed tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:22.481584 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6d7f51c0-bab9-4fc3-a53a-c3755404b4ed tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:22.488286 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6d7f51c0-bab9-4fc3-a53a-c3755404b4ed tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:22.488731 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6d7f51c0-bab9-4fc3-a53a-c3755404b4ed tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:22.489495 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6d7f51c0-bab9-4fc3-a53a-c3755404b4ed tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:22.489921 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6d7f51c0-bab9-4fc3-a53a-c3755404b4ed tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:22.591228 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-df7400ac-9772-48ba-85c6-08e9cb5a30ac tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:22.591918 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-df7400ac-9772-48ba-85c6-08e9cb5a30ac tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:22.599915 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-df7400ac-9772-48ba-85c6-08e9cb5a30ac tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:22.600420 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-df7400ac-9772-48ba-85c6-08e9cb5a30ac tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:22.603195 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-df7400ac-9772-48ba-85c6-08e9cb5a30ac tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:22.603668 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-df7400ac-9772-48ba-85c6-08e9cb5a30ac tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:22.629664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6d7f51c0-bab9-4fc3-a53a-c3755404b4ed tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:22.637014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6d7f51c0-bab9-4fc3-a53a-c3755404b4ed tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1549 microversion: 2.1 time: 0.159721 Nov 19 03:22:22.637508 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 221/417] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:22 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:22.653961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d27570b5-435f-4852-994a-c96b241260bb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:22.654600 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d27570b5-435f-4852-994a-c96b241260bb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:22.662083 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d27570b5-435f-4852-994a-c96b241260bb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:22.662545 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d27570b5-435f-4852-994a-c96b241260bb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:22.663330 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d27570b5-435f-4852-994a-c96b241260bb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:22.663758 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d27570b5-435f-4852-994a-c96b241260bb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:22.665693 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-df7400ac-9772-48ba-85c6-08e9cb5a30ac tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:22.673098 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-df7400ac-9772-48ba-85c6-08e9cb5a30ac tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1311 microversion: 2.1 time: 0.085815 Nov 19 03:22:22.673658 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 197/418] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:22 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:22:22.743575 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d27570b5-435f-4852-994a-c96b241260bb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093713 Nov 19 03:22:22.744199 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 222/419] 10.222.0.47 () {58 vars in 1274 bytes} [Fri Nov 19 03:22:22 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:22:22.979731 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2f0d41dc-67cd-4e01-b43d-55e29c116e18 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:22.980699 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2f0d41dc-67cd-4e01-b43d-55e29c116e18 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:22.986856 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2f0d41dc-67cd-4e01-b43d-55e29c116e18 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:22.987301 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2f0d41dc-67cd-4e01-b43d-55e29c116e18 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:22.988091 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2f0d41dc-67cd-4e01-b43d-55e29c116e18 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:22.988519 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2f0d41dc-67cd-4e01-b43d-55e29c116e18 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:23.428295 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2f0d41dc-67cd-4e01-b43d-55e29c116e18 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:23.437027 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2f0d41dc-67cd-4e01-b43d-55e29c116e18 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.463454 Nov 19 03:22:23.437995 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 198/420] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:22 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:23.447647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f1e786b5-4c7f-4e90-bdd5-098b91e18268 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:23.449210 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f1e786b5-4c7f-4e90-bdd5-098b91e18268 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:23.456876 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f1e786b5-4c7f-4e90-bdd5-098b91e18268 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:23.457577 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f1e786b5-4c7f-4e90-bdd5-098b91e18268 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:23.458677 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f1e786b5-4c7f-4e90-bdd5-098b91e18268 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:23.459225 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f1e786b5-4c7f-4e90-bdd5-098b91e18268 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:23.582048 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f1e786b5-4c7f-4e90-bdd5-098b91e18268 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 28621 microversion: 2.20 time: 0.138563 Nov 19 03:22:23.586192 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 223/421] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:23 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 28621 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:23.690205 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-dd785735-05f6-4809-aa6d-fb4b261e771b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:23.691115 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-dd785735-05f6-4809-aa6d-fb4b261e771b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:23.705325 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dd785735-05f6-4809-aa6d-fb4b261e771b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:23.706018 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dd785735-05f6-4809-aa6d-fb4b261e771b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:23.707018 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dd785735-05f6-4809-aa6d-fb4b261e771b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:23.707608 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dd785735-05f6-4809-aa6d-fb4b261e771b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:23.826376 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-dd785735-05f6-4809-aa6d-fb4b261e771b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:23.835833 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-dd785735-05f6-4809-aa6d-fb4b261e771b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1317 microversion: 2.1 time: 0.149829 Nov 19 03:22:23.837123 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 199/422] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:23 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:24.417201 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-64bfa9ea-9ac6-4f04-b426-918669248e78 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9be4470-ab3f-4943-a794-5b605096220a"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:24.418356 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-64bfa9ea-9ac6-4f04-b426-918669248e78 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:24.426306 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-64bfa9ea-9ac6-4f04-b426-918669248e78 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:24.426779 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-64bfa9ea-9ac6-4f04-b426-918669248e78 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:24.427563 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-64bfa9ea-9ac6-4f04-b426-918669248e78 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:24.428056 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-64bfa9ea-9ac6-4f04-b426-918669248e78 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:24.454687 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-658e10a7-a98d-4f6e-b13a-18c93c82f79c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:24.458007 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-658e10a7-a98d-4f6e-b13a-18c93c82f79c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:24.474096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-658e10a7-a98d-4f6e-b13a-18c93c82f79c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:24.475000 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-658e10a7-a98d-4f6e-b13a-18c93c82f79c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:24.476990 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-658e10a7-a98d-4f6e-b13a-18c93c82f79c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:24.477635 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-658e10a7-a98d-4f6e-b13a-18c93c82f79c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:24.564412 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-64bfa9ea-9ac6-4f04-b426-918669248e78 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] HTTP exception thrown: Invalid volume: volume f9be4470-ab3f-4943-a794-5b605096220a is already attached to instances: 1bbce071-8bbc-400a-b7f8-5e42b947e146 Nov 19 03:22:24.565038 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-64bfa9ea-9ac6-4f04-b426-918669248e78 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Returning 400 to user: Invalid volume: volume f9be4470-ab3f-4943-a794-5b605096220a is already attached to instances: 1bbce071-8bbc-400a-b7f8-5e42b947e146 {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:22:24.565887 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-64bfa9ea-9ac6-4f04-b426-918669248e78 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "POST /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153224 Nov 19 03:22:24.569558 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 224/423] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:22:24 2021] POST /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146/os-volume_attachments => generated 174 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 03:22:24.596250 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4d885d81-b83b-47f9-a418-09056bba3d56 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:24.597183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4d885d81-b83b-47f9-a418-09056bba3d56 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:24.610174 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d885d81-b83b-47f9-a418-09056bba3d56 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:24.610657 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d885d81-b83b-47f9-a418-09056bba3d56 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:24.611462 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d885d81-b83b-47f9-a418-09056bba3d56 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:24.612074 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d885d81-b83b-47f9-a418-09056bba3d56 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:24.867372 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-658e10a7-a98d-4f6e-b13a-18c93c82f79c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:24.880312 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-658e10a7-a98d-4f6e-b13a-18c93c82f79c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.429745 Nov 19 03:22:24.881125 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 200/424] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:24 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:22:24.901462 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-63134b25-e26d-4b1b-bb20-1485bfaad95d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:24.904934 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-63134b25-e26d-4b1b-bb20-1485bfaad95d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:24.918012 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-63134b25-e26d-4b1b-bb20-1485bfaad95d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:24.918803 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-63134b25-e26d-4b1b-bb20-1485bfaad95d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:24.919598 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-63134b25-e26d-4b1b-bb20-1485bfaad95d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:24.920034 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-63134b25-e26d-4b1b-bb20-1485bfaad95d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:25.127339 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.objects.instance [None req-63134b25-e26d-4b1b-bb20-1485bfaad95d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lazy-loading 'services' on Instance uuid 1bbce071-8bbc-400a-b7f8-5e42b947e146 {{(pid=116066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:22:25.277664 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-63134b25-e26d-4b1b-bb20-1485bfaad95d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146/os-volume_attachments/f9be4470-ab3f-4943-a794-5b605096220a" status: 202 len: 0 microversion: 2.1 time: 0.382923 Nov 19 03:22:25.278247 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 201/425] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Nov 19 03:22:24 2021] DELETE /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146/os-volume_attachments/f9be4470-ab3f-4943-a794-5b605096220a => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:25.284305 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7f3994d8-e433-4bf9-b91b-f9529fbc48f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:25.285366 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7f3994d8-e433-4bf9-b91b-f9529fbc48f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:25.292009 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7f3994d8-e433-4bf9-b91b-f9529fbc48f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:25.292460 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7f3994d8-e433-4bf9-b91b-f9529fbc48f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:25.293466 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7f3994d8-e433-4bf9-b91b-f9529fbc48f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:25.294062 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7f3994d8-e433-4bf9-b91b-f9529fbc48f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:48.586317 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4d885d81-b83b-47f9-a418-09056bba3d56 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 34476 microversion: 2.20 time: 23.993660 Nov 19 03:22:48.587390 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 225/426] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:24 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 34476 bytes in 23996 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:22:48.592609 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-652fa6c7-aac2-4e8d-b9d5-8b5d30cb3da8 req-7e1e7b2d-f5a1-4eda-b891-3a89d9d6d472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5741fba7-f551-445e-833f-303eca2c8dae", "tag": "3e4fe64e-0ede-4166-9e29-1ae375f51703"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:48.594070 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:22:48.594070 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:22:48.601807 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-652fa6c7-aac2-4e8d-b9d5-8b5d30cb3da8 req-7e1e7b2d-f5a1-4eda-b891-3a89d9d6d472 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:48.602248 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-652fa6c7-aac2-4e8d-b9d5-8b5d30cb3da8 req-7e1e7b2d-f5a1-4eda-b891-3a89d9d6d472 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:48.613227 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-652fa6c7-aac2-4e8d-b9d5-8b5d30cb3da8 req-7e1e7b2d-f5a1-4eda-b891-3a89d9d6d472 service nova] Creating event network-changed:3e4fe64e-0ede-4166-9e29-1ae375f51703 for instance 5741fba7-f551-445e-833f-303eca2c8dae on hv-cinder-81803 Nov 19 03:22:48.618110 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-652fa6c7-aac2-4e8d-b9d5-8b5d30cb3da8 req-7e1e7b2d-f5a1-4eda-b891-3a89d9d6d472 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029261 Nov 19 03:22:48.618766 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 226/427] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:22:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:22:48.623389 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-763cc819-c30c-45b5-9359-376dadac4d4d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:48.624591 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-763cc819-c30c-45b5-9359-376dadac4d4d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:48.630556 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-763cc819-c30c-45b5-9359-376dadac4d4d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:48.631384 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-763cc819-c30c-45b5-9359-376dadac4d4d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:48.631812 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-763cc819-c30c-45b5-9359-376dadac4d4d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:48.632243 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-763cc819-c30c-45b5-9359-376dadac4d4d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:48.642530 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7f3994d8-e433-4bf9-b91b-f9529fbc48f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 25693 microversion: 2.1 time: 23.362862 Nov 19 03:22:48.644477 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 202/428] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:22:25 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 25693 bytes in 23365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:22:48.649961 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-49fc8aa6-a184-4d31-b679-1f583e4b3098 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:48.651355 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-49fc8aa6-a184-4d31-b679-1f583e4b3098 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:48.659209 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-49fc8aa6-a184-4d31-b679-1f583e4b3098 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:48.659880 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-49fc8aa6-a184-4d31-b679-1f583e4b3098 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:48.660830 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-49fc8aa6-a184-4d31-b679-1f583e4b3098 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:48.661416 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-49fc8aa6-a184-4d31-b679-1f583e4b3098 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:48.691896 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-49fc8aa6-a184-4d31-b679-1f583e4b3098 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045867 Nov 19 03:22:48.692461 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 203/429] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:22:48 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:22:48.701145 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f0953c7e-d24e-4dac-8d1f-14e5e1235c5c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:48.702664 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f0953c7e-d24e-4dac-8d1f-14e5e1235c5c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:48.709419 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f0953c7e-d24e-4dac-8d1f-14e5e1235c5c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:48.709869 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f0953c7e-d24e-4dac-8d1f-14e5e1235c5c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:48.710897 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f0953c7e-d24e-4dac-8d1f-14e5e1235c5c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:48.711338 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f0953c7e-d24e-4dac-8d1f-14e5e1235c5c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:49.012122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-763cc819-c30c-45b5-9359-376dadac4d4d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:49.020241 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-763cc819-c30c-45b5-9359-376dadac4d4d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1359 microversion: 2.1 time: 0.400334 Nov 19 03:22:49.020810 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 227/430] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:48 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1359 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:49.031266 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-f0953c7e-d24e-4dac-8d1f-14e5e1235c5c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:49.039642 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f0953c7e-d24e-4dac-8d1f-14e5e1235c5c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.342363 Nov 19 03:22:49.040229 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 204/431] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:48 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:49.597525 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a9ebe527-872b-40c0-a7f8-e5cdbd05f6fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:49.598558 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a9ebe527-872b-40c0-a7f8-e5cdbd05f6fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:49.606611 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a9ebe527-872b-40c0-a7f8-e5cdbd05f6fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:49.607155 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a9ebe527-872b-40c0-a7f8-e5cdbd05f6fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:49.608563 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a9ebe527-872b-40c0-a7f8-e5cdbd05f6fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:49.609177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a9ebe527-872b-40c0-a7f8-e5cdbd05f6fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:49.653688 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-47e735e3-1d4d-47e8-ac41-8ce837c7420b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:49.654642 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-47e735e3-1d4d-47e8-ac41-8ce837c7420b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:49.660917 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-47e735e3-1d4d-47e8-ac41-8ce837c7420b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:49.661363 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-47e735e3-1d4d-47e8-ac41-8ce837c7420b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:49.662417 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-47e735e3-1d4d-47e8-ac41-8ce837c7420b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:49.662887 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-47e735e3-1d4d-47e8-ac41-8ce837c7420b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:49.778952 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a9ebe527-872b-40c0-a7f8-e5cdbd05f6fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 35147 microversion: 2.20 time: 0.184992 Nov 19 03:22:49.779696 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 228/432] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:49 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 35147 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:22:49.785024 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-57558245-d6b7-40b4-8f27-d447acef8b26 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:49.786022 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-57558245-d6b7-40b4-8f27-d447acef8b26 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:49.792859 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-57558245-d6b7-40b4-8f27-d447acef8b26 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:49.793297 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-57558245-d6b7-40b4-8f27-d447acef8b26 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:49.794061 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-57558245-d6b7-40b4-8f27-d447acef8b26 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:49.794507 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-57558245-d6b7-40b4-8f27-d447acef8b26 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:49.808435 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-47e735e3-1d4d-47e8-ac41-8ce837c7420b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 26464 microversion: 2.1 time: 0.158370 Nov 19 03:22:49.809104 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 205/433] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:22:49 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 26464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:22:49.825439 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-57558245-d6b7-40b4-8f27-d447acef8b26 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044303 Nov 19 03:22:49.826037 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 229/434] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:22:49 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:22:50.037424 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9c68c614-b985-40cd-9148-3729527d1b10 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:50.038112 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9c68c614-b985-40cd-9148-3729527d1b10 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:50.044994 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9c68c614-b985-40cd-9148-3729527d1b10 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:50.046343 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9c68c614-b985-40cd-9148-3729527d1b10 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:50.047189 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9c68c614-b985-40cd-9148-3729527d1b10 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:50.047622 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9c68c614-b985-40cd-9148-3729527d1b10 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:50.056319 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-56ded21a-70d5-4539-93a1-7ec1607e7a27 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:50.056921 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-56ded21a-70d5-4539-93a1-7ec1607e7a27 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:50.063474 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-56ded21a-70d5-4539-93a1-7ec1607e7a27 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:50.064162 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-56ded21a-70d5-4539-93a1-7ec1607e7a27 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:50.064939 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-56ded21a-70d5-4539-93a1-7ec1607e7a27 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:50.065527 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-56ded21a-70d5-4539-93a1-7ec1607e7a27 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:50.264092 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-9c68c614-b985-40cd-9148-3729527d1b10 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:50.273315 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9c68c614-b985-40cd-9148-3729527d1b10 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1359 microversion: 2.1 time: 0.239811 Nov 19 03:22:50.273829 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-56ded21a-70d5-4539-93a1-7ec1607e7a27 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:50.274433 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 206/435] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:50 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:50.283758 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-56ded21a-70d5-4539-93a1-7ec1607e7a27 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.230869 Nov 19 03:22:50.284430 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 230/436] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:50 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:50.636673 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-32b90b89-966a-41e7-a861-d1edd00c8248 req-b3c06bd8-a2fe-48bc-801d-a5c28691d146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140090bc-aacf-4ff7-8c49-35408b97f6f8", "tag": "4ad10a71-4d53-4076-951d-e0ce7c2cbf68"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:50.638193 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:22:50.638193 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:22:50.645873 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-32b90b89-966a-41e7-a861-d1edd00c8248 req-b3c06bd8-a2fe-48bc-801d-a5c28691d146 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:50.646304 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-32b90b89-966a-41e7-a861-d1edd00c8248 req-b3c06bd8-a2fe-48bc-801d-a5c28691d146 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:50.657852 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-32b90b89-966a-41e7-a861-d1edd00c8248 req-b3c06bd8-a2fe-48bc-801d-a5c28691d146 service nova] Creating event network-changed:4ad10a71-4d53-4076-951d-e0ce7c2cbf68 for instance 140090bc-aacf-4ff7-8c49-35408b97f6f8 on hv-cinder-81803 Nov 19 03:22:50.662789 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-32b90b89-966a-41e7-a861-d1edd00c8248 req-b3c06bd8-a2fe-48bc-801d-a5c28691d146 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029598 Nov 19 03:22:50.663387 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 207/437] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:22:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:22:50.790863 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2c241299-cb39-4faf-8107-3ca9bf4f2285 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:50.791855 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2c241299-cb39-4faf-8107-3ca9bf4f2285 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:50.798634 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c241299-cb39-4faf-8107-3ca9bf4f2285 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:50.799079 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c241299-cb39-4faf-8107-3ca9bf4f2285 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:50.799860 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c241299-cb39-4faf-8107-3ca9bf4f2285 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:50.800287 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c241299-cb39-4faf-8107-3ca9bf4f2285 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:50.820995 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-12cb63c3-e7d8-48b1-a7b1-d6d49df4a833 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:50.822556 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-12cb63c3-e7d8-48b1-a7b1-d6d49df4a833 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:50.830375 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-12cb63c3-e7d8-48b1-a7b1-d6d49df4a833 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:50.831105 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-12cb63c3-e7d8-48b1-a7b1-d6d49df4a833 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:50.832281 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-12cb63c3-e7d8-48b1-a7b1-d6d49df4a833 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:50.832715 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-12cb63c3-e7d8-48b1-a7b1-d6d49df4a833 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:50.947894 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2c241299-cb39-4faf-8107-3ca9bf4f2285 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 36176 microversion: 2.20 time: 0.160555 Nov 19 03:22:50.948581 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 231/438] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:50 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 36176 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:50.954381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3cf99370-4414-41d0-9fb8-978336e971d4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:50.955391 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3cf99370-4414-41d0-9fb8-978336e971d4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:50.963573 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3cf99370-4414-41d0-9fb8-978336e971d4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:50.964376 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3cf99370-4414-41d0-9fb8-978336e971d4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:50.965760 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3cf99370-4414-41d0-9fb8-978336e971d4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:50.966604 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3cf99370-4414-41d0-9fb8-978336e971d4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:50.983970 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-12cb63c3-e7d8-48b1-a7b1-d6d49df4a833 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 27301 microversion: 2.1 time: 0.166658 Nov 19 03:22:50.988038 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 208/439] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:22:50 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 27301 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:22:50.999257 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3cf99370-4414-41d0-9fb8-978336e971d4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048848 Nov 19 03:22:51.000468 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 232/440] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:22:50 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:22:51.176722 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1952990408", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "networks": [{"uuid": "cd122154-2aeb-4e66-bcc7-7acf31cd258e"}]}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:51.229690 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.network.neutron [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] validate_networks() for [('cd122154-2aeb-4e66-bcc7-7acf31cd258e', None, None, None, None, None)] {{(pid=116066) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:22:51.290741 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a14ff9b3-401c-4402-ba3d-bea6f9175850 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:51.291519 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a14ff9b3-401c-4402-ba3d-bea6f9175850 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:51.301600 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a14ff9b3-401c-4402-ba3d-bea6f9175850 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:51.302056 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a14ff9b3-401c-4402-ba3d-bea6f9175850 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:51.302900 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a14ff9b3-401c-4402-ba3d-bea6f9175850 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:51.303328 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a14ff9b3-401c-4402-ba3d-bea6f9175850 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:51.504926 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a14ff9b3-401c-4402-ba3d-bea6f9175850 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:51.512460 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a14ff9b3-401c-4402-ba3d-bea6f9175850 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1359 microversion: 2.1 time: 0.225332 Nov 19 03:22:51.513037 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 233/441] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:51 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:22:51.517929 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3d21cf2b-3a17-431b-b3bf-2e511c5a90ae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:51.518551 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3d21cf2b-3a17-431b-b3bf-2e511c5a90ae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:51.524151 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3d21cf2b-3a17-431b-b3bf-2e511c5a90ae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:51.524597 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3d21cf2b-3a17-431b-b3bf-2e511c5a90ae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:51.525632 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3d21cf2b-3a17-431b-b3bf-2e511c5a90ae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:51.526071 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3d21cf2b-3a17-431b-b3bf-2e511c5a90ae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:51.750300 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3d21cf2b-3a17-431b-b3bf-2e511c5a90ae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:51.759145 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3d21cf2b-3a17-431b-b3bf-2e511c5a90ae tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.245098 Nov 19 03:22:51.759728 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 234/442] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:51 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:51.779258 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Flavor limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:22:51.779792 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Image limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:22:51.780304 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Flavor pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:22:51.780820 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Image pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:22:51.781222 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:22:51.789717 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:51.790152 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:51.790981 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:51.791408 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:51.810078 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Getting quotas for project 53690eedb4c749db94ed55f64a323cba. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:22:51.814622 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Getting quotas for user 96438e8630f848a8879dbd29e687d1c1 and project 53690eedb4c749db94ed55f64a323cba. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:22:51.825083 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Going to run 1 instances... {{(pid=116066) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:22:51.827470 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:22:51.878096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c7aeb30f-c5f2-4cc5-a949-4e9c3e46b3a4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705349 Nov 19 03:22:51.879217 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 209/443] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:22:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:22:51.888334 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7f9af667-8c3d-4c96-beb5-ac2518fc863a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:51.888937 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7f9af667-8c3d-4c96-beb5-ac2518fc863a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:51.942796 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7f9af667-8c3d-4c96-beb5-ac2518fc863a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:51.949145 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7f9af667-8c3d-4c96-beb5-ac2518fc863a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1218 microversion: 2.1 time: 0.064460 Nov 19 03:22:51.949982 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 235/444] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:51 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:51.960578 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3f4a73c8-740d-49a9-9fe5-a63310c0cae6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:51.961535 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3f4a73c8-740d-49a9-9fe5-a63310c0cae6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:51.972125 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3f4a73c8-740d-49a9-9fe5-a63310c0cae6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:51.972639 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3f4a73c8-740d-49a9-9fe5-a63310c0cae6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:51.973491 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3f4a73c8-740d-49a9-9fe5-a63310c0cae6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:51.974090 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3f4a73c8-740d-49a9-9fe5-a63310c0cae6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:51.995409 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-89844067-e2db-4872-ad13-464c9c934728 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:51.996376 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-89844067-e2db-4872-ad13-464c9c934728 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:52.007066 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89844067-e2db-4872-ad13-464c9c934728 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:52.007849 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89844067-e2db-4872-ad13-464c9c934728 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:52.008810 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89844067-e2db-4872-ad13-464c9c934728 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:52.009238 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89844067-e2db-4872-ad13-464c9c934728 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:52.174858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3f4a73c8-740d-49a9-9fe5-a63310c0cae6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 37338 microversion: 2.20 time: 0.217723 Nov 19 03:22:52.178527 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 210/445] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:51 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 37338 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:52.213767 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-89844067-e2db-4872-ad13-464c9c934728 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 27644 microversion: 2.1 time: 0.221721 Nov 19 03:22:52.214423 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 236/446] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:22:51 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 27644 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:22:52.530780 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-41fca579-6645-41da-9e86-18b392eacd3a tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:52.531586 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-41fca579-6645-41da-9e86-18b392eacd3a tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:52.538587 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-41fca579-6645-41da-9e86-18b392eacd3a tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:52.539067 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-41fca579-6645-41da-9e86-18b392eacd3a tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:52.539850 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-41fca579-6645-41da-9e86-18b392eacd3a tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:52.540290 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-41fca579-6645-41da-9e86-18b392eacd3a tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:52.670241 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-41fca579-6645-41da-9e86-18b392eacd3a tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:52.677958 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-41fca579-6645-41da-9e86-18b392eacd3a tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1359 microversion: 2.1 time: 0.152010 Nov 19 03:22:52.678536 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 211/447] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:52 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:52.776664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-89191d2c-2e72-44bd-b9c3-80ced936e8aa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:52.777354 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-89191d2c-2e72-44bd-b9c3-80ced936e8aa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:52.784866 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89191d2c-2e72-44bd-b9c3-80ced936e8aa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:52.785316 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89191d2c-2e72-44bd-b9c3-80ced936e8aa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:52.786086 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89191d2c-2e72-44bd-b9c3-80ced936e8aa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:52.786548 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89191d2c-2e72-44bd-b9c3-80ced936e8aa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:52.920913 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-89191d2c-2e72-44bd-b9c3-80ced936e8aa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:52.928643 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-89191d2c-2e72-44bd-b9c3-80ced936e8aa tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.156182 Nov 19 03:22:52.929235 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 237/448] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:52 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:52.966049 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c406dd14-f4d0-47c1-a44e-163dab81cb9e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:52.966687 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c406dd14-f4d0-47c1-a44e-163dab81cb9e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:52.973115 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c406dd14-f4d0-47c1-a44e-163dab81cb9e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:52.973558 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c406dd14-f4d0-47c1-a44e-163dab81cb9e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:52.974328 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c406dd14-f4d0-47c1-a44e-163dab81cb9e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:52.974824 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c406dd14-f4d0-47c1-a44e-163dab81cb9e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:53.034440 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c406dd14-f4d0-47c1-a44e-163dab81cb9e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:53.041604 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c406dd14-f4d0-47c1-a44e-163dab81cb9e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1270 microversion: 2.1 time: 0.079119 Nov 19 03:22:53.042163 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 212/449] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:52 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1270 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:53.186617 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a8a79973-e5ba-4b8d-91b6-f388ddc041d0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:53.187412 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a8a79973-e5ba-4b8d-91b6-f388ddc041d0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:53.193485 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a8a79973-e5ba-4b8d-91b6-f388ddc041d0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:53.193933 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a8a79973-e5ba-4b8d-91b6-f388ddc041d0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:53.194733 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a8a79973-e5ba-4b8d-91b6-f388ddc041d0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:53.195180 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a8a79973-e5ba-4b8d-91b6-f388ddc041d0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:53.227659 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-464194ec-9e60-456e-849e-df1c33a6888f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:53.228627 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-464194ec-9e60-456e-849e-df1c33a6888f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:53.234809 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-464194ec-9e60-456e-849e-df1c33a6888f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:53.235257 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-464194ec-9e60-456e-849e-df1c33a6888f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:53.236184 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-464194ec-9e60-456e-849e-df1c33a6888f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:53.236625 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-464194ec-9e60-456e-849e-df1c33a6888f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:53.357829 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a8a79973-e5ba-4b8d-91b6-f388ddc041d0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 38155 microversion: 2.20 time: 0.175241 Nov 19 03:22:53.358581 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 238/450] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:53 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 38155 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:53.402416 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-464194ec-9e60-456e-849e-df1c33a6888f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 27827 microversion: 2.1 time: 0.179177 Nov 19 03:22:53.406985 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 213/451] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:22:53 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 27827 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:22:53.695215 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e2579f3b-e571-443d-8d40-9c46a705d581 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:53.695909 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e2579f3b-e571-443d-8d40-9c46a705d581 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:53.703522 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e2579f3b-e571-443d-8d40-9c46a705d581 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:53.703968 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e2579f3b-e571-443d-8d40-9c46a705d581 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:53.704952 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e2579f3b-e571-443d-8d40-9c46a705d581 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:53.705388 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e2579f3b-e571-443d-8d40-9c46a705d581 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:53.842630 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e2579f3b-e571-443d-8d40-9c46a705d581 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:53.854850 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e2579f3b-e571-443d-8d40-9c46a705d581 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1359 microversion: 2.1 time: 0.163449 Nov 19 03:22:53.861063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 239/452] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:53 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:53.947210 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-82f5ab2d-a0c7-4ad7-bf23-a02f5dfb9950 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:53.948111 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-82f5ab2d-a0c7-4ad7-bf23-a02f5dfb9950 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:53.957493 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-82f5ab2d-a0c7-4ad7-bf23-a02f5dfb9950 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:53.957926 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-82f5ab2d-a0c7-4ad7-bf23-a02f5dfb9950 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:53.959039 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-82f5ab2d-a0c7-4ad7-bf23-a02f5dfb9950 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:53.960044 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-82f5ab2d-a0c7-4ad7-bf23-a02f5dfb9950 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:54.058978 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-24390258-eb8c-4f2b-b556-cc337f80cec3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:54.060476 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-24390258-eb8c-4f2b-b556-cc337f80cec3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:54.068700 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-24390258-eb8c-4f2b-b556-cc337f80cec3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:54.069157 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-24390258-eb8c-4f2b-b556-cc337f80cec3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:54.074772 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-24390258-eb8c-4f2b-b556-cc337f80cec3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:54.074772 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-24390258-eb8c-4f2b-b556-cc337f80cec3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:54.121268 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-82f5ab2d-a0c7-4ad7-bf23-a02f5dfb9950 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:54.131011 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-82f5ab2d-a0c7-4ad7-bf23-a02f5dfb9950 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.188286 Nov 19 03:22:54.131890 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 214/453] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:53 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:54.219906 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-24390258-eb8c-4f2b-b556-cc337f80cec3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:54.227774 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-24390258-eb8c-4f2b-b556-cc337f80cec3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1318 microversion: 2.1 time: 0.172205 Nov 19 03:22:54.228363 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 240/454] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:54 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:54.369189 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-dfb60317-06b3-4a90-8a59-938b7c2fe47e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:54.370572 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-dfb60317-06b3-4a90-8a59-938b7c2fe47e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:54.377375 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dfb60317-06b3-4a90-8a59-938b7c2fe47e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:54.377966 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dfb60317-06b3-4a90-8a59-938b7c2fe47e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:54.378951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dfb60317-06b3-4a90-8a59-938b7c2fe47e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:54.379526 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dfb60317-06b3-4a90-8a59-938b7c2fe47e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:54.415390 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-90b89493-4ec1-4601-b8e4-db341c27efe8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:54.416424 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-90b89493-4ec1-4601-b8e4-db341c27efe8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:54.423762 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-90b89493-4ec1-4601-b8e4-db341c27efe8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:54.424211 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-90b89493-4ec1-4601-b8e4-db341c27efe8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:54.425241 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-90b89493-4ec1-4601-b8e4-db341c27efe8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:54.425685 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-90b89493-4ec1-4601-b8e4-db341c27efe8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:54.617474 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-dfb60317-06b3-4a90-8a59-938b7c2fe47e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 38155 microversion: 2.20 time: 0.251760 Nov 19 03:22:54.618371 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 215/455] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:54 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 38155 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:54.654266 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-90b89493-4ec1-4601-b8e4-db341c27efe8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28071 microversion: 2.1 time: 0.242516 Nov 19 03:22:54.655027 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 241/456] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:22:54 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28071 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:22:54.791059 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-0b30984f-1030-4837-abd6-1ee8ff79b6e0 req-9211bd83-2aca-45d7-a8fd-5ed6f14557f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcff5f64-47d5-42be-b3d9-178bc26dff6b", "tag": "acf6de7e-c417-4238-b1f6-5062a513bfba"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:54.792732 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:22:54.792732 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:22:54.812510 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-0b30984f-1030-4837-abd6-1ee8ff79b6e0 req-9211bd83-2aca-45d7-a8fd-5ed6f14557f1 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:54.813040 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-0b30984f-1030-4837-abd6-1ee8ff79b6e0 req-9211bd83-2aca-45d7-a8fd-5ed6f14557f1 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:54.825645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-0b30984f-1030-4837-abd6-1ee8ff79b6e0 req-9211bd83-2aca-45d7-a8fd-5ed6f14557f1 service nova] Creating event network-changed:acf6de7e-c417-4238-b1f6-5062a513bfba for instance fcff5f64-47d5-42be-b3d9-178bc26dff6b on hv-cinder-81803 Nov 19 03:22:54.831125 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-0b30984f-1030-4837-abd6-1ee8ff79b6e0 req-9211bd83-2aca-45d7-a8fd-5ed6f14557f1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043871 Nov 19 03:22:54.831721 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 216/457] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:22:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:22:54.873533 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-94e865b7-909d-46b7-ad99-3c95e1770342 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:54.874564 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-94e865b7-909d-46b7-ad99-3c95e1770342 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:54.882237 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-94e865b7-909d-46b7-ad99-3c95e1770342 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:54.882972 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-94e865b7-909d-46b7-ad99-3c95e1770342 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:54.883922 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-94e865b7-909d-46b7-ad99-3c95e1770342 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:54.884586 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-94e865b7-909d-46b7-ad99-3c95e1770342 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:55.075511 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-94e865b7-909d-46b7-ad99-3c95e1770342 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:55.083932 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-94e865b7-909d-46b7-ad99-3c95e1770342 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1359 microversion: 2.1 time: 0.215582 Nov 19 03:22:55.084506 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 242/458] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:54 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:55.149495 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-183eb279-66f5-40aa-ba54-391137ecd228 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:55.150563 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-183eb279-66f5-40aa-ba54-391137ecd228 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:55.157907 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-183eb279-66f5-40aa-ba54-391137ecd228 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:55.158381 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-183eb279-66f5-40aa-ba54-391137ecd228 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:55.159213 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-183eb279-66f5-40aa-ba54-391137ecd228 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:55.159645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-183eb279-66f5-40aa-ba54-391137ecd228 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:55.246833 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e67c6aa3-d6a8-43db-b158-31fd85884bfa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:55.248080 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e67c6aa3-d6a8-43db-b158-31fd85884bfa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:55.255503 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e67c6aa3-d6a8-43db-b158-31fd85884bfa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:55.255961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e67c6aa3-d6a8-43db-b158-31fd85884bfa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:55.256745 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e67c6aa3-d6a8-43db-b158-31fd85884bfa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:55.257306 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e67c6aa3-d6a8-43db-b158-31fd85884bfa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:55.352307 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-183eb279-66f5-40aa-ba54-391137ecd228 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:55.360595 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-183eb279-66f5-40aa-ba54-391137ecd228 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.215691 Nov 19 03:22:55.361367 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 217/459] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:55 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:55.424313 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e67c6aa3-d6a8-43db-b158-31fd85884bfa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:55.431507 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e67c6aa3-d6a8-43db-b158-31fd85884bfa tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1318 microversion: 2.1 time: 0.190207 Nov 19 03:22:55.432074 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 243/460] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:55 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:22:55.631043 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-97c39e89-71ff-4ba2-872d-446f6bfd869d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:55.632054 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-97c39e89-71ff-4ba2-872d-446f6bfd869d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:55.638365 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-97c39e89-71ff-4ba2-872d-446f6bfd869d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:55.638844 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-97c39e89-71ff-4ba2-872d-446f6bfd869d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:55.639769 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-97c39e89-71ff-4ba2-872d-446f6bfd869d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:55.640197 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-97c39e89-71ff-4ba2-872d-446f6bfd869d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:55.667109 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-897f4ca7-60a6-4c8c-a593-9cd6a9c45126 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:55.668144 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-897f4ca7-60a6-4c8c-a593-9cd6a9c45126 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:55.675423 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-897f4ca7-60a6-4c8c-a593-9cd6a9c45126 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:55.675941 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-897f4ca7-60a6-4c8c-a593-9cd6a9c45126 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:55.676776 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-897f4ca7-60a6-4c8c-a593-9cd6a9c45126 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:55.677275 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-897f4ca7-60a6-4c8c-a593-9cd6a9c45126 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:55.825346 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-97c39e89-71ff-4ba2-872d-446f6bfd869d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 38155 microversion: 2.20 time: 0.197733 Nov 19 03:22:55.826680 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 218/461] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:55 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 38155 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:22:55.872458 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-897f4ca7-60a6-4c8c-a593-9cd6a9c45126 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.209844 Nov 19 03:22:55.873226 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 244/462] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:22:55 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:22:56.101795 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9888f246-3392-49e6-b51c-738186a1dcf9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:56.102679 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9888f246-3392-49e6-b51c-738186a1dcf9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:56.110440 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9888f246-3392-49e6-b51c-738186a1dcf9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:56.110913 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9888f246-3392-49e6-b51c-738186a1dcf9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:56.111693 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9888f246-3392-49e6-b51c-738186a1dcf9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:56.112122 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9888f246-3392-49e6-b51c-738186a1dcf9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:56.260798 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-9888f246-3392-49e6-b51c-738186a1dcf9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:56.268097 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9888f246-3392-49e6-b51c-738186a1dcf9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1359 microversion: 2.1 time: 0.170408 Nov 19 03:22:56.268658 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 219/463] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:56 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:56.377553 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a0ff1327-0baf-44e9-ba03-d05ce7f5aa4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:56.378237 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a0ff1327-0baf-44e9-ba03-d05ce7f5aa4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:56.385015 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a0ff1327-0baf-44e9-ba03-d05ce7f5aa4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:56.385458 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a0ff1327-0baf-44e9-ba03-d05ce7f5aa4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:56.386227 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a0ff1327-0baf-44e9-ba03-d05ce7f5aa4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:56.386679 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a0ff1327-0baf-44e9-ba03-d05ce7f5aa4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:56.448822 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d0474537-1759-4d6b-951e-b5fef87a63ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:22:56.449606 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d0474537-1759-4d6b-951e-b5fef87a63ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:56.458303 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d0474537-1759-4d6b-951e-b5fef87a63ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:56.458858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d0474537-1759-4d6b-951e-b5fef87a63ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:56.460016 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d0474537-1759-4d6b-951e-b5fef87a63ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:56.460551 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d0474537-1759-4d6b-951e-b5fef87a63ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:56.547780 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a0ff1327-0baf-44e9-ba03-d05ce7f5aa4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:56.555440 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a0ff1327-0baf-44e9-ba03-d05ce7f5aa4e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.182056 Nov 19 03:22:56.556003 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 245/464] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:56 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:22:56.614642 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d0474537-1759-4d6b-951e-b5fef87a63ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:22:56.621766 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d0474537-1759-4d6b-951e-b5fef87a63ac tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1318 microversion: 2.1 time: 0.176589 Nov 19 03:22:56.622320 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 220/465] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:22:56 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:22:56.837711 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-61cc3d81-68d9-4019-8dce-8f84bd6dc790 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:56.838604 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-61cc3d81-68d9-4019-8dce-8f84bd6dc790 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:56.845076 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-61cc3d81-68d9-4019-8dce-8f84bd6dc790 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:56.845649 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-61cc3d81-68d9-4019-8dce-8f84bd6dc790 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:56.846408 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-61cc3d81-68d9-4019-8dce-8f84bd6dc790 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:56.846860 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-61cc3d81-68d9-4019-8dce-8f84bd6dc790 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:56.884385 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9c096272-7cf8-4cfe-b424-5e73f33789e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:22:56.885343 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9c096272-7cf8-4cfe-b424-5e73f33789e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:22:56.892260 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9c096272-7cf8-4cfe-b424-5e73f33789e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:56.892701 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9c096272-7cf8-4cfe-b424-5e73f33789e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:22:56.893462 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9c096272-7cf8-4cfe-b424-5e73f33789e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:22:56.893889 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9c096272-7cf8-4cfe-b424-5e73f33789e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:00.728196 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-61cc3d81-68d9-4019-8dce-8f84bd6dc790 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 200 len: 38296 microversion: 2.20 time: 3.894063 Nov 19 03:23:00.729232 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 246/466] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:22:56 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 38296 bytes in 3896 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:23:00.735162 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b5e3abc9-faa5-410d-9ee8-13b0df61c896 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:00.735955 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b5e3abc9-faa5-410d-9ee8-13b0df61c896 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:00.743446 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9c096272-7cf8-4cfe-b424-5e73f33789e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 3.862422 Nov 19 03:23:00.744637 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 221/467] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:22:56 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 3864 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:23:00.749437 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-63fe9559-313c-43e5-b589-82370e0e8c83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:00.750158 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-63fe9559-313c-43e5-b589-82370e0e8c83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:00.752713 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b5e3abc9-faa5-410d-9ee8-13b0df61c896 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:00.753462 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b5e3abc9-faa5-410d-9ee8-13b0df61c896 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:00.753965 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b5e3abc9-faa5-410d-9ee8-13b0df61c896 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:00.754403 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b5e3abc9-faa5-410d-9ee8-13b0df61c896 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:00.757341 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-63fe9559-313c-43e5-b589-82370e0e8c83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:00.757802 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-63fe9559-313c-43e5-b589-82370e0e8c83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:00.758629 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-63fe9559-313c-43e5-b589-82370e0e8c83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:00.759105 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-63fe9559-313c-43e5-b589-82370e0e8c83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:00.953437 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b5e3abc9-faa5-410d-9ee8-13b0df61c896 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:00.960482 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-63fe9559-313c-43e5-b589-82370e0e8c83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:00.960870 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b5e3abc9-faa5-410d-9ee8-13b0df61c896 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1359 microversion: 2.1 time: 0.230571 Nov 19 03:23:00.961443 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 247/468] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:00 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:00.965591 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-77eeef26-afdb-48cb-8462-4481c3ed0a1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:00.966188 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-77eeef26-afdb-48cb-8462-4481c3ed0a1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:00.970106 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-63fe9559-313c-43e5-b589-82370e0e8c83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.224258 Nov 19 03:23:00.970711 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 222/469] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:00 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:00.972899 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-77eeef26-afdb-48cb-8462-4481c3ed0a1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:00.973350 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-77eeef26-afdb-48cb-8462-4481c3ed0a1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:00.974122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-77eeef26-afdb-48cb-8462-4481c3ed0a1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:00.974578 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-77eeef26-afdb-48cb-8462-4481c3ed0a1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:00.975055 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2fc6284d-0371-419c-9953-47acb32d434e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:00.975567 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2fc6284d-0371-419c-9953-47acb32d434e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:00.981651 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2fc6284d-0371-419c-9953-47acb32d434e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:00.982265 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2fc6284d-0371-419c-9953-47acb32d434e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:00.983131 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2fc6284d-0371-419c-9953-47acb32d434e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:00.983554 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2fc6284d-0371-419c-9953-47acb32d434e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:01.006812 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2fc6284d-0371-419c-9953-47acb32d434e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/ips" status: 200 len: 150 microversion: 2.20 time: 0.035037 Nov 19 03:23:01.007532 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 223/470] 10.222.0.47 () {60 vars in 1288 bytes} [Fri Nov 19 03:23:00 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:01.112225 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-77eeef26-afdb-48cb-8462-4481c3ed0a1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:01.120117 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-77eeef26-afdb-48cb-8462-4481c3ed0a1d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1318 microversion: 2.1 time: 0.157706 Nov 19 03:23:01.120740 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 248/471] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:00 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:01.755393 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9b1c3361-c18c-4c36-9441-a77ce71f7e67 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:01.756382 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9b1c3361-c18c-4c36-9441-a77ce71f7e67 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:01.762625 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9b1c3361-c18c-4c36-9441-a77ce71f7e67 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:01.763065 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9b1c3361-c18c-4c36-9441-a77ce71f7e67 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:01.763826 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9b1c3361-c18c-4c36-9441-a77ce71f7e67 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:01.764780 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9b1c3361-c18c-4c36-9441-a77ce71f7e67 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:01.978059 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-496dddd1-2484-4a1b-9f90-9deb13cf3c03 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:01.978993 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-496dddd1-2484-4a1b-9f90-9deb13cf3c03 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:01.983047 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9b1c3361-c18c-4c36-9441-a77ce71f7e67 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.231108 Nov 19 03:23:01.986870 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 224/472] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:01 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:01.987028 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-496dddd1-2484-4a1b-9f90-9deb13cf3c03 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:01.987028 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-496dddd1-2484-4a1b-9f90-9deb13cf3c03 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:01.987028 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-496dddd1-2484-4a1b-9f90-9deb13cf3c03 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:01.987287 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-496dddd1-2484-4a1b-9f90-9deb13cf3c03 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:01.988555 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-eeaab931-eba6-4565-b99b-13fd5f56fd62 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:01.989237 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-eeaab931-eba6-4565-b99b-13fd5f56fd62 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:01.995916 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eeaab931-eba6-4565-b99b-13fd5f56fd62 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:01.996357 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eeaab931-eba6-4565-b99b-13fd5f56fd62 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:01.997130 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eeaab931-eba6-4565-b99b-13fd5f56fd62 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:01.997567 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eeaab931-eba6-4565-b99b-13fd5f56fd62 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:02.179237 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-496dddd1-2484-4a1b-9f90-9deb13cf3c03 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:02.187065 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-496dddd1-2484-4a1b-9f90-9deb13cf3c03 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1359 microversion: 2.1 time: 0.212657 Nov 19 03:23:02.187684 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 249/473] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:01 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:02.191893 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b53b2f98-c625-4047-9ff8-4f5a278bc0e5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:02.192486 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b53b2f98-c625-4047-9ff8-4f5a278bc0e5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:02.193556 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-eeaab931-eba6-4565-b99b-13fd5f56fd62 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:02.198292 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b53b2f98-c625-4047-9ff8-4f5a278bc0e5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:02.198756 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b53b2f98-c625-4047-9ff8-4f5a278bc0e5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:02.199519 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b53b2f98-c625-4047-9ff8-4f5a278bc0e5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:02.199946 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b53b2f98-c625-4047-9ff8-4f5a278bc0e5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:02.201484 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-eeaab931-eba6-4565-b99b-13fd5f56fd62 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.216564 Nov 19 03:23:02.202664 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 225/474] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:01 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:02.329720 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b53b2f98-c625-4047-9ff8-4f5a278bc0e5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:02.337994 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b53b2f98-c625-4047-9ff8-4f5a278bc0e5 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1318 microversion: 2.1 time: 0.149144 Nov 19 03:23:02.338989 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 250/475] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:02 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:02.787199 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-edb0784e-8382-4d1e-a6c3-b89479d17d7d req-21460725-e27e-4914-8dc7-bd97ab3fbdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140090bc-aacf-4ff7-8c49-35408b97f6f8", "name": "network-vif-plugged", "status": "completed", "tag": "4ad10a71-4d53-4076-951d-e0ce7c2cbf68"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:02.788854 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:23:02.788854 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:23:02.797020 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-edb0784e-8382-4d1e-a6c3-b89479d17d7d req-21460725-e27e-4914-8dc7-bd97ab3fbdc8 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:02.797469 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-edb0784e-8382-4d1e-a6c3-b89479d17d7d req-21460725-e27e-4914-8dc7-bd97ab3fbdc8 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:02.809482 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-edb0784e-8382-4d1e-a6c3-b89479d17d7d req-21460725-e27e-4914-8dc7-bd97ab3fbdc8 service nova] Creating event network-vif-plugged:4ad10a71-4d53-4076-951d-e0ce7c2cbf68 for instance 140090bc-aacf-4ff7-8c49-35408b97f6f8 on hv-cinder-81803 Nov 19 03:23:02.815204 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-edb0784e-8382-4d1e-a6c3-b89479d17d7d req-21460725-e27e-4914-8dc7-bd97ab3fbdc8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032398 Nov 19 03:23:02.815995 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 226/476] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:23:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:23:02.993645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-55a63cb5-d010-4f69-803a-aa28fb87b28c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:02.994640 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-55a63cb5-d010-4f69-803a-aa28fb87b28c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:03.001778 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-55a63cb5-d010-4f69-803a-aa28fb87b28c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:03.002319 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-55a63cb5-d010-4f69-803a-aa28fb87b28c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:03.003217 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-55a63cb5-d010-4f69-803a-aa28fb87b28c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:03.003733 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-55a63cb5-d010-4f69-803a-aa28fb87b28c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:03.145574 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-55a63cb5-d010-4f69-803a-aa28fb87b28c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.155371 Nov 19 03:23:03.146237 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 251/477] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:02 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:03.204251 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-074dc3a6-0001-482f-854f-7d9005c7717d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:03.204857 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-074dc3a6-0001-482f-854f-7d9005c7717d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:03.211256 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-074dc3a6-0001-482f-854f-7d9005c7717d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:03.211689 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-074dc3a6-0001-482f-854f-7d9005c7717d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:03.212477 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-074dc3a6-0001-482f-854f-7d9005c7717d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:03.212899 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-074dc3a6-0001-482f-854f-7d9005c7717d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:03.219325 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3dda9b07-5b44-4a23-9634-ae43e08697d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:03.220055 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3dda9b07-5b44-4a23-9634-ae43e08697d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:03.226923 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3dda9b07-5b44-4a23-9634-ae43e08697d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:03.227370 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3dda9b07-5b44-4a23-9634-ae43e08697d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:03.228152 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3dda9b07-5b44-4a23-9634-ae43e08697d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:03.228590 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3dda9b07-5b44-4a23-9634-ae43e08697d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:03.407306 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-074dc3a6-0001-482f-854f-7d9005c7717d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:03.414576 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3dda9b07-5b44-4a23-9634-ae43e08697d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:03.414721 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-074dc3a6-0001-482f-854f-7d9005c7717d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1359 microversion: 2.1 time: 0.214422 Nov 19 03:23:03.415180 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 227/478] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:03 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:03.421415 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b57d2dc9-058d-4bf1-8c1d-f6e699a15b29 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:03.421995 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b57d2dc9-058d-4bf1-8c1d-f6e699a15b29 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:03.424168 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3dda9b07-5b44-4a23-9634-ae43e08697d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.208977 Nov 19 03:23:03.424815 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 252/479] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:03 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:03.427713 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b57d2dc9-058d-4bf1-8c1d-f6e699a15b29 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:03.428161 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b57d2dc9-058d-4bf1-8c1d-f6e699a15b29 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:03.428935 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b57d2dc9-058d-4bf1-8c1d-f6e699a15b29 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:03.429366 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b57d2dc9-058d-4bf1-8c1d-f6e699a15b29 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:03.429663 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a56407de-820b-4d21-96ee-81cf3d5b0dfb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:03.430190 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a56407de-820b-4d21-96ee-81cf3d5b0dfb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:03.435899 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a56407de-820b-4d21-96ee-81cf3d5b0dfb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:03.436351 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a56407de-820b-4d21-96ee-81cf3d5b0dfb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:03.437129 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a56407de-820b-4d21-96ee-81cf3d5b0dfb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:03.437566 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a56407de-820b-4d21-96ee-81cf3d5b0dfb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:03.462434 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-a56407de-820b-4d21-96ee-81cf3d5b0dfb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lazy-loading 'flavor' on Instance uuid 8641ae42-77ad-4054-8073-76018892c1d8 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:03.570883 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b57d2dc9-058d-4bf1-8c1d-f6e699a15b29 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:03.578782 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b57d2dc9-058d-4bf1-8c1d-f6e699a15b29 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1318 microversion: 2.1 time: 0.162573 Nov 19 03:23:03.579543 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 228/480] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:03 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:03.733372 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a56407de-820b-4d21-96ee-81cf3d5b0dfb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 202 len: 0 microversion: 2.20 time: 0.306808 Nov 19 03:23:03.734000 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 253/481] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:23:03 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:23:03.741872 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2005efa7-5ee6-476d-a847-67216a2d22f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:03.742501 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2005efa7-5ee6-476d-a847-67216a2d22f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:03.748828 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2005efa7-5ee6-476d-a847-67216a2d22f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:03.749274 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2005efa7-5ee6-476d-a847-67216a2d22f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:03.750043 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2005efa7-5ee6-476d-a847-67216a2d22f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:03.750492 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2005efa7-5ee6-476d-a847-67216a2d22f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:03.879404 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2005efa7-5ee6-476d-a847-67216a2d22f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:03.887117 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2005efa7-5ee6-476d-a847-67216a2d22f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:03.888665 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2005efa7-5ee6-476d-a847-67216a2d22f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:03.890404 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2005efa7-5ee6-476d-a847-67216a2d22f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1721 microversion: 2.20 time: 0.152140 Nov 19 03:23:03.891074 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 229/482] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:03 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:04.158859 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-228792fd-873a-4faf-b46f-c6f43027e92a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:04.159833 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-228792fd-873a-4faf-b46f-c6f43027e92a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:04.166038 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-228792fd-873a-4faf-b46f-c6f43027e92a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:04.166493 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-228792fd-873a-4faf-b46f-c6f43027e92a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:04.167257 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-228792fd-873a-4faf-b46f-c6f43027e92a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:04.167686 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-228792fd-873a-4faf-b46f-c6f43027e92a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:04.262589 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-228792fd-873a-4faf-b46f-c6f43027e92a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.108645 Nov 19 03:23:04.263198 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 254/483] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:04 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:04.432096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2f03181f-bee1-40a7-9626-7bc476c29f4c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:04.432690 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2f03181f-bee1-40a7-9626-7bc476c29f4c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:04.439650 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2f03181f-bee1-40a7-9626-7bc476c29f4c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:04.440092 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2f03181f-bee1-40a7-9626-7bc476c29f4c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:04.440857 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2f03181f-bee1-40a7-9626-7bc476c29f4c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:04.441285 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2f03181f-bee1-40a7-9626-7bc476c29f4c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:04.441626 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-cc91a7b8-f3e9-481a-aba0-63c3f8f60b04 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:04.442327 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-cc91a7b8-f3e9-481a-aba0-63c3f8f60b04 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:04.449166 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc91a7b8-f3e9-481a-aba0-63c3f8f60b04 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:04.449614 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc91a7b8-f3e9-481a-aba0-63c3f8f60b04 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:04.450393 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc91a7b8-f3e9-481a-aba0-63c3f8f60b04 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:04.450855 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc91a7b8-f3e9-481a-aba0-63c3f8f60b04 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:04.635857 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2f03181f-bee1-40a7-9626-7bc476c29f4c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:04.643673 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2f03181f-bee1-40a7-9626-7bc476c29f4c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1359 microversion: 2.1 time: 0.215463 Nov 19 03:23:04.644258 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 230/484] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:04 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:04.648584 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8d55c138-bb00-48d0-beb3-1331f7fe6d91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:04.649185 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8d55c138-bb00-48d0-beb3-1331f7fe6d91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:04.650444 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-cc91a7b8-f3e9-481a-aba0-63c3f8f60b04 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:04.656710 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8d55c138-bb00-48d0-beb3-1331f7fe6d91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:04.657453 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8d55c138-bb00-48d0-beb3-1331f7fe6d91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:04.658270 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8d55c138-bb00-48d0-beb3-1331f7fe6d91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:04.658802 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8d55c138-bb00-48d0-beb3-1331f7fe6d91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:04.665699 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-cc91a7b8-f3e9-481a-aba0-63c3f8f60b04 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.227865 Nov 19 03:23:04.666520 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 255/485] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:04 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:04.807676 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8d55c138-bb00-48d0-beb3-1331f7fe6d91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:04.815765 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8d55c138-bb00-48d0-beb3-1331f7fe6d91 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1318 microversion: 2.1 time: 0.170494 Nov 19 03:23:04.816343 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 231/486] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:04 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:04.909477 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-429c9e3d-6d02-4658-82f0-ca91c7f8d9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:04.910077 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-429c9e3d-6d02-4658-82f0-ca91c7f8d9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:04.916376 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-429c9e3d-6d02-4658-82f0-ca91c7f8d9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:04.916819 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-429c9e3d-6d02-4658-82f0-ca91c7f8d9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:04.917591 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-429c9e3d-6d02-4658-82f0-ca91c7f8d9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:04.918004 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-429c9e3d-6d02-4658-82f0-ca91c7f8d9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:05.053393 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-429c9e3d-6d02-4658-82f0-ca91c7f8d9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:05.061612 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-429c9e3d-6d02-4658-82f0-ca91c7f8d9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:05.063270 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-429c9e3d-6d02-4658-82f0-ca91c7f8d9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:05.064434 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-429c9e3d-6d02-4658-82f0-ca91c7f8d9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1721 microversion: 2.20 time: 0.158681 Nov 19 03:23:05.064994 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 256/487] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:04 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:05.274762 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-33857eca-9db4-4f76-a621-64ceaa6496d4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:05.275930 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-33857eca-9db4-4f76-a621-64ceaa6496d4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:05.282329 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-33857eca-9db4-4f76-a621-64ceaa6496d4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:05.282816 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-33857eca-9db4-4f76-a621-64ceaa6496d4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:05.283584 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-33857eca-9db4-4f76-a621-64ceaa6496d4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:05.284010 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-33857eca-9db4-4f76-a621-64ceaa6496d4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:05.661695 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5d5818b6-4c33-44d7-9e35-e9990cfd68f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:05.662242 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5d5818b6-4c33-44d7-9e35-e9990cfd68f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:05.668376 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5d5818b6-4c33-44d7-9e35-e9990cfd68f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:05.668818 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5d5818b6-4c33-44d7-9e35-e9990cfd68f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:05.669574 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5d5818b6-4c33-44d7-9e35-e9990cfd68f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:05.669998 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5d5818b6-4c33-44d7-9e35-e9990cfd68f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:05.800237 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5d5818b6-4c33-44d7-9e35-e9990cfd68f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:05.807420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5d5818b6-4c33-44d7-9e35-e9990cfd68f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1359 microversion: 2.1 time: 0.149467 Nov 19 03:23:05.807990 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 257/488] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:05 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:05.812665 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a5e40e10-ca7f-4ebf-9daf-6ab270fc57c7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:05.813257 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a5e40e10-ca7f-4ebf-9daf-6ab270fc57c7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:05.818657 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a5e40e10-ca7f-4ebf-9daf-6ab270fc57c7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:05.819110 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a5e40e10-ca7f-4ebf-9daf-6ab270fc57c7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:05.819884 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a5e40e10-ca7f-4ebf-9daf-6ab270fc57c7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:05.820322 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a5e40e10-ca7f-4ebf-9daf-6ab270fc57c7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:05.959788 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a5e40e10-ca7f-4ebf-9daf-6ab270fc57c7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:05.967813 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a5e40e10-ca7f-4ebf-9daf-6ab270fc57c7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.158895 Nov 19 03:23:05.968374 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 258/489] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:05 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:05.972642 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c522301d-6412-4c64-b0c5-736e6dcb16d2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:05.973320 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c522301d-6412-4c64-b0c5-736e6dcb16d2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:05.978841 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c522301d-6412-4c64-b0c5-736e6dcb16d2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:05.979282 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c522301d-6412-4c64-b0c5-736e6dcb16d2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:05.980036 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c522301d-6412-4c64-b0c5-736e6dcb16d2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:05.980480 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c522301d-6412-4c64-b0c5-736e6dcb16d2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:06.041902 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-33857eca-9db4-4f76-a621-64ceaa6496d4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.770637 Nov 19 03:23:06.046566 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 232/490] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:05 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:06.086944 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d835a9a9-e816-426c-9c29-f59e9a99840e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:06.087646 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d835a9a9-e816-426c-9c29-f59e9a99840e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:06.095497 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d835a9a9-e816-426c-9c29-f59e9a99840e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:06.095951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d835a9a9-e816-426c-9c29-f59e9a99840e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:06.096745 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d835a9a9-e816-426c-9c29-f59e9a99840e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:06.097181 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d835a9a9-e816-426c-9c29-f59e9a99840e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:06.129961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c522301d-6412-4c64-b0c5-736e6dcb16d2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:06.139608 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c522301d-6412-4c64-b0c5-736e6dcb16d2 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1318 microversion: 2.1 time: 0.169806 Nov 19 03:23:06.140408 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 259/491] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:05 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:06.267960 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d835a9a9-e816-426c-9c29-f59e9a99840e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:06.276070 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d835a9a9-e816-426c-9c29-f59e9a99840e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:06.277553 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d835a9a9-e816-426c-9c29-f59e9a99840e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:06.278726 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d835a9a9-e816-426c-9c29-f59e9a99840e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1721 microversion: 2.20 time: 0.195988 Nov 19 03:23:06.279275 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 233/492] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:06 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:23:06.824601 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-212d0e28-60f7-4bef-86aa-bcc15d1e548c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:06.825203 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-212d0e28-60f7-4bef-86aa-bcc15d1e548c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:06.832059 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-212d0e28-60f7-4bef-86aa-bcc15d1e548c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:06.832499 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-212d0e28-60f7-4bef-86aa-bcc15d1e548c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:06.833259 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-212d0e28-60f7-4bef-86aa-bcc15d1e548c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:06.833686 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-212d0e28-60f7-4bef-86aa-bcc15d1e548c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:06.963191 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-212d0e28-60f7-4bef-86aa-bcc15d1e548c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:06.971353 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-212d0e28-60f7-4bef-86aa-bcc15d1e548c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1549 microversion: 2.1 time: 0.150340 Nov 19 03:23:06.971922 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 260/493] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:06 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:06.984834 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c628e639-8c72-49f6-bb83-b00454158f2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:06.985574 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c628e639-8c72-49f6-bb83-b00454158f2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:06.986596 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-417ccc8d-7a4c-42d1-8f61-36b82ef4f8cd tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:06.987245 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-417ccc8d-7a4c-42d1-8f61-36b82ef4f8cd tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:06.992264 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c628e639-8c72-49f6-bb83-b00454158f2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:06.992787 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c628e639-8c72-49f6-bb83-b00454158f2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:06.993645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-417ccc8d-7a4c-42d1-8f61-36b82ef4f8cd tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:06.993783 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c628e639-8c72-49f6-bb83-b00454158f2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:06.994113 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-417ccc8d-7a4c-42d1-8f61-36b82ef4f8cd tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:06.994283 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c628e639-8c72-49f6-bb83-b00454158f2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:06.994944 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-417ccc8d-7a4c-42d1-8f61-36b82ef4f8cd tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:06.995389 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-417ccc8d-7a4c-42d1-8f61-36b82ef4f8cd tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:07.458636 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c628e639-8c72-49f6-bb83-b00454158f2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:07.466372 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-417ccc8d-7a4c-42d1-8f61-36b82ef4f8cd tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:07.466845 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c628e639-8c72-49f6-bb83-b00454158f2f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1569 microversion: 2.1 time: 0.486072 Nov 19 03:23:07.468056 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 234/494] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:06 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1569 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:07.472460 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ab9b9fae-342b-40f6-a539-8f7b700bd1dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:07.473392 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ab9b9fae-342b-40f6-a539-8f7b700bd1dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:07.479874 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab9b9fae-342b-40f6-a539-8f7b700bd1dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:07.480081 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab9b9fae-342b-40f6-a539-8f7b700bd1dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:07.480800 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab9b9fae-342b-40f6-a539-8f7b700bd1dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:07.481244 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ab9b9fae-342b-40f6-a539-8f7b700bd1dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:07.483754 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-417ccc8d-7a4c-42d1-8f61-36b82ef4f8cd tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1549 microversion: 2.1 time: 0.500381 Nov 19 03:23:07.484610 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 261/495] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:06 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1549 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:07.490407 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1afe066a-ce68-4a4b-94f0-30ea869af25c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:07.491033 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1afe066a-ce68-4a4b-94f0-30ea869af25c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:07.497780 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1afe066a-ce68-4a4b-94f0-30ea869af25c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:07.499257 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1afe066a-ce68-4a4b-94f0-30ea869af25c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:07.500234 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1afe066a-ce68-4a4b-94f0-30ea869af25c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:07.500911 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1afe066a-ce68-4a4b-94f0-30ea869af25c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:07.582323 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ab9b9fae-342b-40f6-a539-8f7b700bd1dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.112972 Nov 19 03:23:07.583192 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 235/496] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:07 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:07.588648 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-fba5dd4b-7a18-4f4c-a8fe-d3ac712565f9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:07.589524 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-fba5dd4b-7a18-4f4c-a8fe-d3ac712565f9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:07.596660 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fba5dd4b-7a18-4f4c-a8fe-d3ac712565f9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:07.597444 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fba5dd4b-7a18-4f4c-a8fe-d3ac712565f9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:07.598742 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fba5dd4b-7a18-4f4c-a8fe-d3ac712565f9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:07.599333 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fba5dd4b-7a18-4f4c-a8fe-d3ac712565f9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:07.665385 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1afe066a-ce68-4a4b-94f0-30ea869af25c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:07.673704 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1afe066a-ce68-4a4b-94f0-30ea869af25c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1318 microversion: 2.1 time: 0.188318 Nov 19 03:23:07.674304 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 262/497] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:07 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:07.688138 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-88a23cd9-f84a-4a65-9fc4-edac0597f700 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:07.691492 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:23:07.691492 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:23:07.692783 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-88a23cd9-f84a-4a65-9fc4-edac0597f700 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:07.693709 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-88a23cd9-f84a-4a65-9fc4-edac0597f700 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Searching by: {'deleted': False, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61'} {{(pid=116065) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 19 03:23:07.700326 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-88a23cd9-f84a-4a65-9fc4-edac0597f700 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:07.700769 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-88a23cd9-f84a-4a65-9fc4-edac0597f700 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:07.702151 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-88a23cd9-f84a-4a65-9fc4-edac0597f700 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:07.702689 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-88a23cd9-f84a-4a65-9fc4-edac0597f700 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:07.754592 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-fba5dd4b-7a18-4f4c-a8fe-d3ac712565f9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:07.763920 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-fba5dd4b-7a18-4f4c-a8fe-d3ac712565f9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:07.769294 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-fba5dd4b-7a18-4f4c-a8fe-d3ac712565f9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:07.770731 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-fba5dd4b-7a18-4f4c-a8fe-d3ac712565f9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1721 microversion: 2.20 time: 0.186265 Nov 19 03:23:07.772000 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 236/498] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:07 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:07.805734 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.multi_cell_list [None req-88a23cd9-f84a-4a65-9fc4-edac0597f700 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116065) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 19 03:23:07.903574 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-88a23cd9-f84a-4a65-9fc4-edac0597f700 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.219194 Nov 19 03:23:07.904268 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 263/499] 10.222.0.47 () {58 vars in 1124 bytes} [Fri Nov 19 03:23:07 2021] GET /compute/v2.1/servers => generated 343 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:07.915165 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a568d261-5eea-4c7a-9de6-ebaf6ef34b60 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:07.915786 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a568d261-5eea-4c7a-9de6-ebaf6ef34b60 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:07.922760 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a568d261-5eea-4c7a-9de6-ebaf6ef34b60 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:07.923206 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a568d261-5eea-4c7a-9de6-ebaf6ef34b60 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:07.923999 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a568d261-5eea-4c7a-9de6-ebaf6ef34b60 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:07.924426 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a568d261-5eea-4c7a-9de6-ebaf6ef34b60 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.065254 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a568d261-5eea-4c7a-9de6-ebaf6ef34b60 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:08.072637 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a568d261-5eea-4c7a-9de6-ebaf6ef34b60 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1549 microversion: 2.1 time: 0.161123 Nov 19 03:23:08.073198 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 237/500] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:07 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:08.484850 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ca15ea3e-3f75-4507-8d1f-6280e90aed32 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:08.485453 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ca15ea3e-3f75-4507-8d1f-6280e90aed32 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:08.491122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ca15ea3e-3f75-4507-8d1f-6280e90aed32 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.491567 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ca15ea3e-3f75-4507-8d1f-6280e90aed32 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.492331 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ca15ea3e-3f75-4507-8d1f-6280e90aed32 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.492759 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ca15ea3e-3f75-4507-8d1f-6280e90aed32 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.594416 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d0ce30dc-2a9f-4985-9808-8768ae472c2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:08.595583 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d0ce30dc-2a9f-4985-9808-8768ae472c2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:08.601858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d0ce30dc-2a9f-4985-9808-8768ae472c2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.602303 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d0ce30dc-2a9f-4985-9808-8768ae472c2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.603116 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d0ce30dc-2a9f-4985-9808-8768ae472c2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.603573 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d0ce30dc-2a9f-4985-9808-8768ae472c2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.629567 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ca15ea3e-3f75-4507-8d1f-6280e90aed32 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:08.638893 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ca15ea3e-3f75-4507-8d1f-6280e90aed32 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1549 microversion: 2.1 time: 0.158144 Nov 19 03:23:08.639651 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 264/501] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:08 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:08.655645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d38becaa-a6ed-4fde-b2d4-b729048430f6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:08.656385 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d38becaa-a6ed-4fde-b2d4-b729048430f6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:08.662097 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d38becaa-a6ed-4fde-b2d4-b729048430f6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.662575 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d38becaa-a6ed-4fde-b2d4-b729048430f6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.663344 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d38becaa-a6ed-4fde-b2d4-b729048430f6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.663772 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d38becaa-a6ed-4fde-b2d4-b729048430f6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.716968 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d0ce30dc-2a9f-4985-9808-8768ae472c2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.126013 Nov 19 03:23:08.721337 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 238/502] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:08 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:23:08.723437 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0a953fdc-a9fb-4b38-b4b3-015c2cdb7a48 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:08.724137 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0a953fdc-a9fb-4b38-b4b3-015c2cdb7a48 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:08.731341 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a953fdc-a9fb-4b38-b4b3-015c2cdb7a48 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.731794 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a953fdc-a9fb-4b38-b4b3-015c2cdb7a48 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.732577 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a953fdc-a9fb-4b38-b4b3-015c2cdb7a48 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.733246 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a953fdc-a9fb-4b38-b4b3-015c2cdb7a48 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.744384 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-d38becaa-a6ed-4fde-b2d4-b729048430f6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] HTTP exception thrown: Cannot 'detach_volume' instance b19ae39a-79ce-4adb-9ee4-595daa1a8d27 while it is in vm_state rescued Nov 19 03:23:08.744972 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d38becaa-a6ed-4fde-b2d4-b729048430f6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Returning 409 to user: Cannot 'detach_volume' instance b19ae39a-79ce-4adb-9ee4-595daa1a8d27 while it is in vm_state rescued {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:23:08.745799 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d38becaa-a6ed-4fde-b2d4-b729048430f6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments/bb3dae86-eb8b-45c3-bfac-1a616aa85dc0" status: 409 len: 152 microversion: 2.1 time: 0.094322 Nov 19 03:23:08.746352 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 265/503] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Nov 19 03:23:08 2021] DELETE /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments/bb3dae86-eb8b-45c3-bfac-1a616aa85dc0 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 19 03:23:08.754775 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0871cfef-d7de-4bbd-9b32-db812d59cefc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:08.755404 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0871cfef-d7de-4bbd-9b32-db812d59cefc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:08.761440 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0871cfef-d7de-4bbd-9b32-db812d59cefc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.761889 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0871cfef-d7de-4bbd-9b32-db812d59cefc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.762751 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0871cfef-d7de-4bbd-9b32-db812d59cefc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.763240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0871cfef-d7de-4bbd-9b32-db812d59cefc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.836115 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0871cfef-d7de-4bbd-9b32-db812d59cefc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "POST /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/action" status: 202 len: 0 microversion: 2.1 time: 0.084581 Nov 19 03:23:08.839906 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 266/504] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:08 2021] POST /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:23:08.844793 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d7324803-6f23-44af-a8d5-c7f4fdc1f87e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:08.845588 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d7324803-6f23-44af-a8d5-c7f4fdc1f87e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:08.854884 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d7324803-6f23-44af-a8d5-c7f4fdc1f87e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.855448 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d7324803-6f23-44af-a8d5-c7f4fdc1f87e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.856341 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d7324803-6f23-44af-a8d5-c7f4fdc1f87e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.856845 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d7324803-6f23-44af-a8d5-c7f4fdc1f87e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.888867 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0a953fdc-a9fb-4b38-b4b3-015c2cdb7a48 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:08.896955 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0a953fdc-a9fb-4b38-b4b3-015c2cdb7a48 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1318 microversion: 2.1 time: 0.177415 Nov 19 03:23:08.897529 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 239/505] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:08 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:08.905179 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-fb143ea5-418c-4a9e-bda1-8881a1b6e51a req-02df2c63-bc2f-484a-b6f7-909e4b5098de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcff5f64-47d5-42be-b3d9-178bc26dff6b", "name": "network-vif-plugged", "status": "completed", "tag": "acf6de7e-c417-4238-b1f6-5062a513bfba"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:08.907088 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:23:08.907088 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:23:08.914044 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-fb143ea5-418c-4a9e-bda1-8881a1b6e51a req-02df2c63-bc2f-484a-b6f7-909e4b5098de service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.914510 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-fb143ea5-418c-4a9e-bda1-8881a1b6e51a req-02df2c63-bc2f-484a-b6f7-909e4b5098de service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.925345 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-fb143ea5-418c-4a9e-bda1-8881a1b6e51a req-02df2c63-bc2f-484a-b6f7-909e4b5098de service nova] Creating event network-vif-plugged:acf6de7e-c417-4238-b1f6-5062a513bfba for instance fcff5f64-47d5-42be-b3d9-178bc26dff6b on hv-cinder-81803 Nov 19 03:23:08.930032 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-fb143ea5-418c-4a9e-bda1-8881a1b6e51a req-02df2c63-bc2f-484a-b6f7-909e4b5098de service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031221 Nov 19 03:23:08.930682 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 240/506] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:23:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:08.935430 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-15cc9285-3790-4d7d-b7be-c396dd304145 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:08.936969 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-15cc9285-3790-4d7d-b7be-c396dd304145 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:08.943313 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-15cc9285-3790-4d7d-b7be-c396dd304145 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.943767 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-15cc9285-3790-4d7d-b7be-c396dd304145 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:08.944555 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-15cc9285-3790-4d7d-b7be-c396dd304145 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:08.944993 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-15cc9285-3790-4d7d-b7be-c396dd304145 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:09.137880 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d7324803-6f23-44af-a8d5-c7f4fdc1f87e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:09.146683 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d7324803-6f23-44af-a8d5-c7f4fdc1f87e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:09.148480 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d7324803-6f23-44af-a8d5-c7f4fdc1f87e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:09.149820 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d7324803-6f23-44af-a8d5-c7f4fdc1f87e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1721 microversion: 2.20 time: 0.311619 Nov 19 03:23:09.150601 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 267/507] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:08 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1721 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:09.216218 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-15cc9285-3790-4d7d-b7be-c396dd304145 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:09.224019 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-15cc9285-3790-4d7d-b7be-c396dd304145 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1557 microversion: 2.1 time: 0.292260 Nov 19 03:23:09.224584 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 241/508] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:08 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1557 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:09.548454 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-99f89c38-1d20-4b6c-add2-2b278253c52d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02a2ed31-73ce-42a6-b7a4-4a0bff8182f8"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:09.549554 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-99f89c38-1d20-4b6c-add2-2b278253c52d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:09.555664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-99f89c38-1d20-4b6c-add2-2b278253c52d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:09.556115 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-99f89c38-1d20-4b6c-add2-2b278253c52d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:09.556892 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-99f89c38-1d20-4b6c-add2-2b278253c52d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:09.557326 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-99f89c38-1d20-4b6c-add2-2b278253c52d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:09.727914 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ff09b641-4ce2-4760-be63-4bac7da6f484 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:09.728892 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ff09b641-4ce2-4760-be63-4bac7da6f484 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:09.735467 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ff09b641-4ce2-4760-be63-4bac7da6f484 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:09.736042 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ff09b641-4ce2-4760-be63-4bac7da6f484 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:09.736693 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ff09b641-4ce2-4760-be63-4bac7da6f484 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:09.737234 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ff09b641-4ce2-4760-be63-4bac7da6f484 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:09.912773 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ff09b641-4ce2-4760-be63-4bac7da6f484 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.188317 Nov 19 03:23:09.913406 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 242/509] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:09 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:23:09.918649 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c0aba72a-7853-4c30-ac84-4d35967f780b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:09.919517 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c0aba72a-7853-4c30-ac84-4d35967f780b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:09.927273 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c0aba72a-7853-4c30-ac84-4d35967f780b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:09.927715 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c0aba72a-7853-4c30-ac84-4d35967f780b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:09.928493 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c0aba72a-7853-4c30-ac84-4d35967f780b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:09.928917 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c0aba72a-7853-4c30-ac84-4d35967f780b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:10.001704 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-99f89c38-1d20-4b6c-add2-2b278253c52d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "POST /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457457 Nov 19 03:23:10.002509 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 268/510] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:23:09 2021] POST /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments => generated 194 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:10.147740 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c0aba72a-7853-4c30-ac84-4d35967f780b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:10.155859 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c0aba72a-7853-4c30-ac84-4d35967f780b tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1318 microversion: 2.1 time: 0.241044 Nov 19 03:23:10.156413 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 243/511] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:09 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:10.168474 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b42bc490-364d-4084-b793-ea0f3ff7624f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:10.170355 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b42bc490-364d-4084-b793-ea0f3ff7624f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:10.177253 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b42bc490-364d-4084-b793-ea0f3ff7624f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:10.177728 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b42bc490-364d-4084-b793-ea0f3ff7624f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:10.178545 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b42bc490-364d-4084-b793-ea0f3ff7624f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:10.178989 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b42bc490-364d-4084-b793-ea0f3ff7624f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:10.242126 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6f41fc28-40cf-4f84-8bd8-f4e99db75ccf tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:10.242754 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6f41fc28-40cf-4f84-8bd8-f4e99db75ccf tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:10.249508 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6f41fc28-40cf-4f84-8bd8-f4e99db75ccf tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:10.250007 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6f41fc28-40cf-4f84-8bd8-f4e99db75ccf tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:10.250814 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6f41fc28-40cf-4f84-8bd8-f4e99db75ccf tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:10.251241 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6f41fc28-40cf-4f84-8bd8-f4e99db75ccf tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:10.345976 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b42bc490-364d-4084-b793-ea0f3ff7624f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:10.353832 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b42bc490-364d-4084-b793-ea0f3ff7624f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:10.355425 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b42bc490-364d-4084-b793-ea0f3ff7624f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:10.356673 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b42bc490-364d-4084-b793-ea0f3ff7624f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1721 microversion: 2.20 time: 0.192128 Nov 19 03:23:10.367253 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 269/512] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:10 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:10.407808 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-6f41fc28-40cf-4f84-8bd8-f4e99db75ccf tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:10.415556 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6f41fc28-40cf-4f84-8bd8-f4e99db75ccf tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1557 microversion: 2.1 time: 0.177171 Nov 19 03:23:10.416115 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 244/513] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:10 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:10.924453 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b2f58106-943a-4b2a-a428-32eafd599d3d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:10.925420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b2f58106-943a-4b2a-a428-32eafd599d3d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:10.931957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b2f58106-943a-4b2a-a428-32eafd599d3d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:10.932405 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b2f58106-943a-4b2a-a428-32eafd599d3d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:10.933202 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b2f58106-943a-4b2a-a428-32eafd599d3d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:10.933634 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b2f58106-943a-4b2a-a428-32eafd599d3d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:11.079557 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b2f58106-943a-4b2a-a428-32eafd599d3d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.158752 Nov 19 03:23:11.081023 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 270/514] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:10 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:11.172519 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-107dc7f9-3522-4835-9e75-c0876caac341 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:11.173126 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-107dc7f9-3522-4835-9e75-c0876caac341 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:11.179361 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-107dc7f9-3522-4835-9e75-c0876caac341 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:11.179807 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-107dc7f9-3522-4835-9e75-c0876caac341 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:11.180577 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-107dc7f9-3522-4835-9e75-c0876caac341 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:11.181006 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-107dc7f9-3522-4835-9e75-c0876caac341 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:11.321988 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-107dc7f9-3522-4835-9e75-c0876caac341 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:11.329641 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-107dc7f9-3522-4835-9e75-c0876caac341 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1318 microversion: 2.1 time: 0.160665 Nov 19 03:23:11.330198 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 245/515] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:11 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:11.375653 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c9d1670f-8843-482d-8f9b-599bf48df593 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:11.376342 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c9d1670f-8843-482d-8f9b-599bf48df593 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:11.383169 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c9d1670f-8843-482d-8f9b-599bf48df593 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:11.383609 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c9d1670f-8843-482d-8f9b-599bf48df593 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:11.384381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c9d1670f-8843-482d-8f9b-599bf48df593 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:11.384824 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c9d1670f-8843-482d-8f9b-599bf48df593 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:11.432847 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-bf251fbd-da81-4da9-8c69-52bf89e36d51 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:11.433454 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-bf251fbd-da81-4da9-8c69-52bf89e36d51 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:11.439971 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bf251fbd-da81-4da9-8c69-52bf89e36d51 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:11.440419 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bf251fbd-da81-4da9-8c69-52bf89e36d51 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:11.441201 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bf251fbd-da81-4da9-8c69-52bf89e36d51 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:11.441632 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bf251fbd-da81-4da9-8c69-52bf89e36d51 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:11.543156 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c9d1670f-8843-482d-8f9b-599bf48df593 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:11.551533 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c9d1670f-8843-482d-8f9b-599bf48df593 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:11.553108 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c9d1670f-8843-482d-8f9b-599bf48df593 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:11.554343 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c9d1670f-8843-482d-8f9b-599bf48df593 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1721 microversion: 2.20 time: 0.183220 Nov 19 03:23:11.554909 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 271/516] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:11 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:11.611350 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-bf251fbd-da81-4da9-8c69-52bf89e36d51 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:11.618981 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-bf251fbd-da81-4da9-8c69-52bf89e36d51 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1557 microversion: 2.1 time: 0.189809 Nov 19 03:23:11.619543 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 246/517] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:11 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1557 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:12.091526 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2da99cec-dd02-4ee6-b74d-0e70aa81c0f4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:12.093346 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2da99cec-dd02-4ee6-b74d-0e70aa81c0f4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:12.099550 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2da99cec-dd02-4ee6-b74d-0e70aa81c0f4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:12.099997 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2da99cec-dd02-4ee6-b74d-0e70aa81c0f4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:12.100754 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2da99cec-dd02-4ee6-b74d-0e70aa81c0f4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:12.101181 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2da99cec-dd02-4ee6-b74d-0e70aa81c0f4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:12.202440 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2da99cec-dd02-4ee6-b74d-0e70aa81c0f4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.113843 Nov 19 03:23:12.203094 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 272/518] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:12 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:12.347574 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5a68031f-0012-451b-b72d-800a75bf1717 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:12.348110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5a68031f-0012-451b-b72d-800a75bf1717 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:12.354314 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5a68031f-0012-451b-b72d-800a75bf1717 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:12.354794 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5a68031f-0012-451b-b72d-800a75bf1717 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:12.355562 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5a68031f-0012-451b-b72d-800a75bf1717 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:12.355992 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5a68031f-0012-451b-b72d-800a75bf1717 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:12.484763 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5a68031f-0012-451b-b72d-800a75bf1717 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:12.492009 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5a68031f-0012-451b-b72d-800a75bf1717 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1509 microversion: 2.1 time: 0.148121 Nov 19 03:23:12.492569 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 247/519] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:12 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:12.573295 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2c5cd332-f40d-45b4-baed-0e5a391e7c53 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:12.573980 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2c5cd332-f40d-45b4-baed-0e5a391e7c53 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:12.581201 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c5cd332-f40d-45b4-baed-0e5a391e7c53 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:12.581646 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c5cd332-f40d-45b4-baed-0e5a391e7c53 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:12.582417 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c5cd332-f40d-45b4-baed-0e5a391e7c53 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:12.582880 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c5cd332-f40d-45b4-baed-0e5a391e7c53 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:12.635764 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d43263b0-6cb4-4b22-8a1f-4337df6b63ef tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:12.636416 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d43263b0-6cb4-4b22-8a1f-4337df6b63ef tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:12.642334 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d43263b0-6cb4-4b22-8a1f-4337df6b63ef tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:12.642826 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d43263b0-6cb4-4b22-8a1f-4337df6b63ef tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:12.643610 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d43263b0-6cb4-4b22-8a1f-4337df6b63ef tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:12.644048 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d43263b0-6cb4-4b22-8a1f-4337df6b63ef tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:12.761440 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2c5cd332-f40d-45b4-baed-0e5a391e7c53 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:12.776351 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2c5cd332-f40d-45b4-baed-0e5a391e7c53 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:12.777953 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2c5cd332-f40d-45b4-baed-0e5a391e7c53 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:12.779732 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2c5cd332-f40d-45b4-baed-0e5a391e7c53 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1721 microversion: 2.20 time: 0.210079 Nov 19 03:23:12.780713 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 273/520] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:12 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:12.825200 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d43263b0-6cb4-4b22-8a1f-4337df6b63ef tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:12.833211 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d43263b0-6cb4-4b22-8a1f-4337df6b63ef tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1557 microversion: 2.1 time: 0.201201 Nov 19 03:23:12.833907 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 248/521] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:12 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1557 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:13.212806 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2c38e5d6-1a03-41e0-abd9-c588c042ce6a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:13.213720 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2c38e5d6-1a03-41e0-abd9-c588c042ce6a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:13.220649 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c38e5d6-1a03-41e0-abd9-c588c042ce6a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:13.221103 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c38e5d6-1a03-41e0-abd9-c588c042ce6a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:13.221909 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c38e5d6-1a03-41e0-abd9-c588c042ce6a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:13.222345 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c38e5d6-1a03-41e0-abd9-c588c042ce6a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:13.343740 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2c38e5d6-1a03-41e0-abd9-c588c042ce6a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.134168 Nov 19 03:23:13.344356 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 274/522] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:13 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:13.797817 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-29ed4d0b-d75a-49fa-8adc-ea26c162a6f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:13.798420 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-29ed4d0b-d75a-49fa-8adc-ea26c162a6f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:13.804463 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-29ed4d0b-d75a-49fa-8adc-ea26c162a6f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:13.804905 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-29ed4d0b-d75a-49fa-8adc-ea26c162a6f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:13.805670 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-29ed4d0b-d75a-49fa-8adc-ea26c162a6f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:13.806109 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-29ed4d0b-d75a-49fa-8adc-ea26c162a6f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:13.825327 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-dfb7dcd6-555d-4431-82c4-62ca07e207cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee92a730-a67a-497f-ac94-069addf4300a"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:13.827597 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-dfb7dcd6-555d-4431-82c4-62ca07e207cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:13.834307 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dfb7dcd6-555d-4431-82c4-62ca07e207cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:13.834790 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dfb7dcd6-555d-4431-82c4-62ca07e207cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:13.835558 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dfb7dcd6-555d-4431-82c4-62ca07e207cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:13.835984 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dfb7dcd6-555d-4431-82c4-62ca07e207cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:13.938438 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-29ed4d0b-d75a-49fa-8adc-ea26c162a6f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:13.946107 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-29ed4d0b-d75a-49fa-8adc-ea26c162a6f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:13.947606 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-29ed4d0b-d75a-49fa-8adc-ea26c162a6f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:13.948754 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-29ed4d0b-d75a-49fa-8adc-ea26c162a6f6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1721 microversion: 2.20 time: 0.154475 Nov 19 03:23:13.949331 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 249/523] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:13 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:13.954289 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-943d868d-2a92-4d0c-bba2-5fd0e01dfd81 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:13.954916 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-943d868d-2a92-4d0c-bba2-5fd0e01dfd81 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:13.960793 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-943d868d-2a92-4d0c-bba2-5fd0e01dfd81 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:13.961319 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-943d868d-2a92-4d0c-bba2-5fd0e01dfd81 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:13.962202 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-943d868d-2a92-4d0c-bba2-5fd0e01dfd81 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:13.962681 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-943d868d-2a92-4d0c-bba2-5fd0e01dfd81 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:14.103391 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-943d868d-2a92-4d0c-bba2-5fd0e01dfd81 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:14.112368 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-943d868d-2a92-4d0c-bba2-5fd0e01dfd81 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1557 microversion: 2.1 time: 0.162037 Nov 19 03:23:14.113013 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 250/524] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:13 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:14.135138 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-dfb7dcd6-555d-4431-82c4-62ca07e207cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "POST /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313683 Nov 19 03:23:14.135763 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 275/525] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:23:13 2021] POST /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:14.355112 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-002174cd-6a63-4d81-a798-249177000ecf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:14.356067 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-002174cd-6a63-4d81-a798-249177000ecf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:14.362007 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-002174cd-6a63-4d81-a798-249177000ecf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:14.362447 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-002174cd-6a63-4d81-a798-249177000ecf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:14.363237 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-002174cd-6a63-4d81-a798-249177000ecf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:14.363660 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-002174cd-6a63-4d81-a798-249177000ecf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:14.579417 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-002174cd-6a63-4d81-a798-249177000ecf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.227617 Nov 19 03:23:14.583350 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 251/526] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:14 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:14.968864 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7a30e802-ef5f-4c0e-8fff-7d0fbc0febbb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:14.969551 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7a30e802-ef5f-4c0e-8fff-7d0fbc0febbb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:14.975911 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7a30e802-ef5f-4c0e-8fff-7d0fbc0febbb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:14.976363 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7a30e802-ef5f-4c0e-8fff-7d0fbc0febbb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:14.977152 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7a30e802-ef5f-4c0e-8fff-7d0fbc0febbb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:14.977589 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7a30e802-ef5f-4c0e-8fff-7d0fbc0febbb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:15.110625 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7a30e802-ef5f-4c0e-8fff-7d0fbc0febbb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:15.118239 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7a30e802-ef5f-4c0e-8fff-7d0fbc0febbb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:15.119741 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7a30e802-ef5f-4c0e-8fff-7d0fbc0febbb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:15.120879 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7a30e802-ef5f-4c0e-8fff-7d0fbc0febbb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1721 microversion: 2.20 time: 0.156570 Nov 19 03:23:15.121436 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 276/527] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:14 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:15.129986 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cf4e49a7-9c71-41b3-ba03-5d4af8d6e749 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:15.130713 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-cf4e49a7-9c71-41b3-ba03-5d4af8d6e749 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:15.137982 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf4e49a7-9c71-41b3-ba03-5d4af8d6e749 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:15.138529 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf4e49a7-9c71-41b3-ba03-5d4af8d6e749 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:15.139341 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf4e49a7-9c71-41b3-ba03-5d4af8d6e749 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:15.139764 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf4e49a7-9c71-41b3-ba03-5d4af8d6e749 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:15.271308 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-cf4e49a7-9c71-41b3-ba03-5d4af8d6e749 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:15.279599 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cf4e49a7-9c71-41b3-ba03-5d4af8d6e749 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1563 microversion: 2.1 time: 0.153566 Nov 19 03:23:15.280178 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 252/528] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:15 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:15.344041 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0c051999-1fc9-4882-bcbd-105b47de8908 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:15.344531 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0c051999-1fc9-4882-bcbd-105b47de8908 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:15.350228 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0c051999-1fc9-4882-bcbd-105b47de8908 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:15.350702 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0c051999-1fc9-4882-bcbd-105b47de8908 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:15.351466 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0c051999-1fc9-4882-bcbd-105b47de8908 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:15.351894 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0c051999-1fc9-4882-bcbd-105b47de8908 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:15.429199 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-0c051999-1fc9-4882-bcbd-105b47de8908 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'services' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:15.495576 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0c051999-1fc9-4882-bcbd-105b47de8908 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments/bb3dae86-eb8b-45c3-bfac-1a616aa85dc0" status: 202 len: 0 microversion: 2.1 time: 0.155298 Nov 19 03:23:15.496478 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 277/529] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Nov 19 03:23:15 2021] DELETE /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments/bb3dae86-eb8b-45c3-bfac-1a616aa85dc0 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:23:15.504879 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cf4a48f9-9dce-4142-ab14-446aa6b4ab44 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:15.505781 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-cf4a48f9-9dce-4142-ab14-446aa6b4ab44 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:15.511978 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf4a48f9-9dce-4142-ab14-446aa6b4ab44 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:15.512417 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf4a48f9-9dce-4142-ab14-446aa6b4ab44 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:15.513182 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf4a48f9-9dce-4142-ab14-446aa6b4ab44 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:15.513603 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf4a48f9-9dce-4142-ab14-446aa6b4ab44 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:15.544136 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cf4a48f9-9dce-4142-ab14-446aa6b4ab44 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042923 Nov 19 03:23:15.544888 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 253/530] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:15 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:15.591183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2cc82a9c-436d-4346-9e4e-336ede375b2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:15.592896 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2cc82a9c-436d-4346-9e4e-336ede375b2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:15.598975 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2cc82a9c-436d-4346-9e4e-336ede375b2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:15.599519 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2cc82a9c-436d-4346-9e4e-336ede375b2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:15.601116 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2cc82a9c-436d-4346-9e4e-336ede375b2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:15.601116 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2cc82a9c-436d-4346-9e4e-336ede375b2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:15.869267 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2cc82a9c-436d-4346-9e4e-336ede375b2a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.281735 Nov 19 03:23:15.870143 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 278/531] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:15 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:16.139947 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5e150d62-93d2-4da4-8573-d46c07b69f1f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:16.140677 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5e150d62-93d2-4da4-8573-d46c07b69f1f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:16.146887 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5e150d62-93d2-4da4-8573-d46c07b69f1f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:16.147328 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5e150d62-93d2-4da4-8573-d46c07b69f1f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:16.148110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5e150d62-93d2-4da4-8573-d46c07b69f1f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:16.148515 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5e150d62-93d2-4da4-8573-d46c07b69f1f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:16.293772 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5e150d62-93d2-4da4-8573-d46c07b69f1f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:16.301557 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5e150d62-93d2-4da4-8573-d46c07b69f1f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:16.303062 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5e150d62-93d2-4da4-8573-d46c07b69f1f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:16.304208 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5e150d62-93d2-4da4-8573-d46c07b69f1f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1742 microversion: 2.20 time: 0.168624 Nov 19 03:23:16.304990 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 254/532] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:16 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1742 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:23:16.556732 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-71bcc5a9-8932-40c0-a1f7-87140189c9d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:16.557729 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-71bcc5a9-8932-40c0-a1f7-87140189c9d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:16.565282 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71bcc5a9-8932-40c0-a1f7-87140189c9d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:16.565730 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71bcc5a9-8932-40c0-a1f7-87140189c9d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:16.566535 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71bcc5a9-8932-40c0-a1f7-87140189c9d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:16.566972 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71bcc5a9-8932-40c0-a1f7-87140189c9d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:16.596393 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-71bcc5a9-8932-40c0-a1f7-87140189c9d8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043640 Nov 19 03:23:16.596878 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 279/533] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:16 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:16.880879 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-82ebc7b6-41c0-4d69-ab29-32b40ecab8f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:16.881734 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-82ebc7b6-41c0-4d69-ab29-32b40ecab8f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:16.887985 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-82ebc7b6-41c0-4d69-ab29-32b40ecab8f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:16.888429 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-82ebc7b6-41c0-4d69-ab29-32b40ecab8f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:16.889824 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-82ebc7b6-41c0-4d69-ab29-32b40ecab8f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:16.890255 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-82ebc7b6-41c0-4d69-ab29-32b40ecab8f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:16.996247 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-82ebc7b6-41c0-4d69-ab29-32b40ecab8f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.118948 Nov 19 03:23:16.996874 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 255/534] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:16 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:17.323157 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a5a84a32-adda-4920-a6c3-ec1f98b49f9b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:17.325337 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a5a84a32-adda-4920-a6c3-ec1f98b49f9b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:17.333102 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a5a84a32-adda-4920-a6c3-ec1f98b49f9b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:17.341618 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a5a84a32-adda-4920-a6c3-ec1f98b49f9b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:17.341618 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a5a84a32-adda-4920-a6c3-ec1f98b49f9b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:17.341618 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a5a84a32-adda-4920-a6c3-ec1f98b49f9b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:17.470837 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a5a84a32-adda-4920-a6c3-ec1f98b49f9b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:17.478498 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a5a84a32-adda-4920-a6c3-ec1f98b49f9b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:17.479985 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a5a84a32-adda-4920-a6c3-ec1f98b49f9b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:17.481138 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a5a84a32-adda-4920-a6c3-ec1f98b49f9b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1742 microversion: 2.20 time: 0.162281 Nov 19 03:23:17.481793 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 280/535] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:17 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:17.515049 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4c1d3ccb-4d26-4188-a977-e59ca6ec6008 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:17.515746 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4c1d3ccb-4d26-4188-a977-e59ca6ec6008 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:17.522550 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4c1d3ccb-4d26-4188-a977-e59ca6ec6008 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:17.523010 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4c1d3ccb-4d26-4188-a977-e59ca6ec6008 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:17.523787 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4c1d3ccb-4d26-4188-a977-e59ca6ec6008 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:17.524221 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4c1d3ccb-4d26-4188-a977-e59ca6ec6008 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:17.611447 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-47f623a1-1017-48bc-ae92-a63b35e8c3b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:17.612118 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-47f623a1-1017-48bc-ae92-a63b35e8c3b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:17.618413 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-47f623a1-1017-48bc-ae92-a63b35e8c3b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:17.618900 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-47f623a1-1017-48bc-ae92-a63b35e8c3b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:17.619681 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-47f623a1-1017-48bc-ae92-a63b35e8c3b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:17.620115 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-47f623a1-1017-48bc-ae92-a63b35e8c3b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:17.649417 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-47f623a1-1017-48bc-ae92-a63b35e8c3b2 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045042 Nov 19 03:23:17.650176 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 281/536] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:17 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:17.664552 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-4c1d3ccb-4d26-4188-a977-e59ca6ec6008 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:17.672506 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4c1d3ccb-4d26-4188-a977-e59ca6ec6008 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1595 microversion: 2.1 time: 0.161931 Nov 19 03:23:17.673012 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 256/537] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:17 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1595 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:18.007653 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3b00f2cf-d37a-4a38-b038-204fa0bf76b4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:18.008590 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3b00f2cf-d37a-4a38-b038-204fa0bf76b4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:18.015741 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3b00f2cf-d37a-4a38-b038-204fa0bf76b4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:18.016203 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3b00f2cf-d37a-4a38-b038-204fa0bf76b4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:18.016979 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3b00f2cf-d37a-4a38-b038-204fa0bf76b4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:18.017415 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3b00f2cf-d37a-4a38-b038-204fa0bf76b4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:18.143456 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3b00f2cf-d37a-4a38-b038-204fa0bf76b4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28188 microversion: 2.1 time: 0.139285 Nov 19 03:23:18.147510 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 282/538] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:18 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28188 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:18.498727 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a5169132-e41f-49d6-a387-dcf431c1b12f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:18.499317 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a5169132-e41f-49d6-a387-dcf431c1b12f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:18.505660 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a5169132-e41f-49d6-a387-dcf431c1b12f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:18.506099 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a5169132-e41f-49d6-a387-dcf431c1b12f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:18.507085 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a5169132-e41f-49d6-a387-dcf431c1b12f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:18.507513 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a5169132-e41f-49d6-a387-dcf431c1b12f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:18.662678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-577aff31-aefc-4a7e-8b87-76ec40483e97 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:18.663548 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-577aff31-aefc-4a7e-8b87-76ec40483e97 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:18.671004 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-577aff31-aefc-4a7e-8b87-76ec40483e97 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:18.671460 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-577aff31-aefc-4a7e-8b87-76ec40483e97 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:18.672241 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-577aff31-aefc-4a7e-8b87-76ec40483e97 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:18.672673 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-577aff31-aefc-4a7e-8b87-76ec40483e97 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:18.703659 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-577aff31-aefc-4a7e-8b87-76ec40483e97 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Nov 19 03:23:18.704239 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 283/539] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:18 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:23:18.755231 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a5169132-e41f-49d6-a387-dcf431c1b12f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:18.764376 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a5169132-e41f-49d6-a387-dcf431c1b12f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:18.765867 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a5169132-e41f-49d6-a387-dcf431c1b12f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:18.767067 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a5169132-e41f-49d6-a387-dcf431c1b12f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1742 microversion: 2.20 time: 0.272082 Nov 19 03:23:18.767626 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 257/540] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:18 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1742 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:19.156520 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0d651b19-d583-412d-a460-051b8bf2ae1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:19.157450 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0d651b19-d583-412d-a460-051b8bf2ae1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:19.163626 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d651b19-d583-412d-a460-051b8bf2ae1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:19.164072 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d651b19-d583-412d-a460-051b8bf2ae1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:19.164844 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d651b19-d583-412d-a460-051b8bf2ae1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:19.165272 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d651b19-d583-412d-a460-051b8bf2ae1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:19.287016 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0d651b19-d583-412d-a460-051b8bf2ae1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28479 microversion: 2.1 time: 0.134809 Nov 19 03:23:19.287670 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 284/541] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:19 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28479 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:19.715078 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3d66d8eb-537b-47be-bb4b-e67001d21ac0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:19.717049 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3d66d8eb-537b-47be-bb4b-e67001d21ac0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:19.727531 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3d66d8eb-537b-47be-bb4b-e67001d21ac0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:19.728191 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3d66d8eb-537b-47be-bb4b-e67001d21ac0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:19.729082 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3d66d8eb-537b-47be-bb4b-e67001d21ac0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:19.729807 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3d66d8eb-537b-47be-bb4b-e67001d21ac0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:19.734868 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-52c195b8-78bf-4d11-a890-b34243b49393 req-d93c5695-274b-4d19-9d70-04c5efee7cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140090bc-aacf-4ff7-8c49-35408b97f6f8", "tag": "4ad10a71-4d53-4076-951d-e0ce7c2cbf68"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:19.736428 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:23:19.736428 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:23:19.756522 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-52c195b8-78bf-4d11-a890-b34243b49393 req-d93c5695-274b-4d19-9d70-04c5efee7cf8 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:19.756957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-52c195b8-78bf-4d11-a890-b34243b49393 req-d93c5695-274b-4d19-9d70-04c5efee7cf8 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:19.763329 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3d66d8eb-537b-47be-bb4b-e67001d21ac0 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051913 Nov 19 03:23:19.764400 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 258/542] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:19 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:19.785332 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b0f00e44-31f0-4c99-b2eb-047bd5c5afa9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:19.786132 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b0f00e44-31f0-4c99-b2eb-047bd5c5afa9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:19.788985 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-52c195b8-78bf-4d11-a890-b34243b49393 req-d93c5695-274b-4d19-9d70-04c5efee7cf8 service nova] Creating event network-changed:4ad10a71-4d53-4076-951d-e0ce7c2cbf68 for instance 140090bc-aacf-4ff7-8c49-35408b97f6f8 on hv-cinder-81803 Nov 19 03:23:19.793506 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b0f00e44-31f0-4c99-b2eb-047bd5c5afa9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:19.794159 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b0f00e44-31f0-4c99-b2eb-047bd5c5afa9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:19.794451 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-52c195b8-78bf-4d11-a890-b34243b49393 req-d93c5695-274b-4d19-9d70-04c5efee7cf8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069979 Nov 19 03:23:19.796100 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b0f00e44-31f0-4c99-b2eb-047bd5c5afa9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:19.796289 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 285/543] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:23:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:19.797063 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b0f00e44-31f0-4c99-b2eb-047bd5c5afa9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:20.018655 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b0f00e44-31f0-4c99-b2eb-047bd5c5afa9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:20.028495 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b0f00e44-31f0-4c99-b2eb-047bd5c5afa9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:20.034993 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b0f00e44-31f0-4c99-b2eb-047bd5c5afa9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:20.038789 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b0f00e44-31f0-4c99-b2eb-047bd5c5afa9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1742 microversion: 2.20 time: 0.257026 Nov 19 03:23:20.041550 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 259/544] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:19 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1742 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:20.302062 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b24dd3a8-97fd-4bd4-afe1-6fd731246984 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:20.303122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b24dd3a8-97fd-4bd4-afe1-6fd731246984 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:20.309991 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b24dd3a8-97fd-4bd4-afe1-6fd731246984 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:20.310835 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b24dd3a8-97fd-4bd4-afe1-6fd731246984 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:20.312361 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b24dd3a8-97fd-4bd4-afe1-6fd731246984 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:20.313083 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b24dd3a8-97fd-4bd4-afe1-6fd731246984 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:20.409629 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b24dd3a8-97fd-4bd4-afe1-6fd731246984 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28479 microversion: 2.1 time: 0.114067 Nov 19 03:23:20.414310 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 286/545] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:20 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28479 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:20.775831 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d82b5494-454f-4aa4-b29c-d87aac7b8e67 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:20.777732 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d82b5494-454f-4aa4-b29c-d87aac7b8e67 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:20.784752 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d82b5494-454f-4aa4-b29c-d87aac7b8e67 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:20.785318 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d82b5494-454f-4aa4-b29c-d87aac7b8e67 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:20.786092 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d82b5494-454f-4aa4-b29c-d87aac7b8e67 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:20.786788 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d82b5494-454f-4aa4-b29c-d87aac7b8e67 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:20.817477 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d82b5494-454f-4aa4-b29c-d87aac7b8e67 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Nov 19 03:23:20.818604 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 260/546] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:20 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:20.899381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1871df83-6907-4d8a-b324-ae08e30109a7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1932230399"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:20.900017 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1871df83-6907-4d8a-b324-ae08e30109a7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:20.909089 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1871df83-6907-4d8a-b324-ae08e30109a7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:20.909542 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1871df83-6907-4d8a-b324-ae08e30109a7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:20.910328 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1871df83-6907-4d8a-b324-ae08e30109a7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:20.910784 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1871df83-6907-4d8a-b324-ae08e30109a7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:21.031565 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-ef0eae96-57fd-40fb-ad37-5efa57fd283c req-c3e56209-0d04-4eaa-bc27-831464eeb9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8641ae42-77ad-4054-8073-76018892c1d8", "name": "network-vif-plugged", "status": "completed", "tag": "4b50d896-6a79-4185-a31c-1931a0b889be"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:21.033356 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:23:21.033356 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:23:21.040575 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-ef0eae96-57fd-40fb-ad37-5efa57fd283c req-c3e56209-0d04-4eaa-bc27-831464eeb9d3 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:21.041024 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-ef0eae96-57fd-40fb-ad37-5efa57fd283c req-c3e56209-0d04-4eaa-bc27-831464eeb9d3 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:21.047898 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.network.security_group_api [None req-1871df83-6907-4d8a-b324-ae08e30109a7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Adding security group 9598f72b-c6c1-440d-a3d9-1474d29d38f6 to port 4ad10a71-4d53-4076-951d-e0ce7c2cbf68 Nov 19 03:23:21.053858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-ef0eae96-57fd-40fb-ad37-5efa57fd283c req-c3e56209-0d04-4eaa-bc27-831464eeb9d3 service nova] Creating event network-vif-plugged:4b50d896-6a79-4185-a31c-1931a0b889be for instance 8641ae42-77ad-4054-8073-76018892c1d8 on hv-cinder-81803 Nov 19 03:23:21.065933 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-ef0eae96-57fd-40fb-ad37-5efa57fd283c req-c3e56209-0d04-4eaa-bc27-831464eeb9d3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038300 Nov 19 03:23:21.066883 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 261/547] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:23:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:23:21.077783 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-35b41503-97c1-4ac0-9679-c1016e08d9ae tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:21.078497 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-35b41503-97c1-4ac0-9679-c1016e08d9ae tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:21.084670 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-35b41503-97c1-4ac0-9679-c1016e08d9ae tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:21.085113 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-35b41503-97c1-4ac0-9679-c1016e08d9ae tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:21.085898 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-35b41503-97c1-4ac0-9679-c1016e08d9ae tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:21.086338 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-35b41503-97c1-4ac0-9679-c1016e08d9ae tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:21.304591 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-35b41503-97c1-4ac0-9679-c1016e08d9ae tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:21.313081 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-35b41503-97c1-4ac0-9679-c1016e08d9ae tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:21.314594 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-35b41503-97c1-4ac0-9679-c1016e08d9ae tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:21.315744 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-35b41503-97c1-4ac0-9679-c1016e08d9ae tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1742 microversion: 2.20 time: 0.247621 Nov 19 03:23:21.316301 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 262/548] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:21 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1742 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:21.421728 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6ff9f60c-16dd-4b84-ae2d-2309d4fde879 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:21.422840 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6ff9f60c-16dd-4b84-ae2d-2309d4fde879 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:21.430033 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ff9f60c-16dd-4b84-ae2d-2309d4fde879 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:21.430499 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ff9f60c-16dd-4b84-ae2d-2309d4fde879 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:21.431559 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ff9f60c-16dd-4b84-ae2d-2309d4fde879 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:21.432505 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ff9f60c-16dd-4b84-ae2d-2309d4fde879 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:21.475303 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1871df83-6907-4d8a-b324-ae08e30109a7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "POST /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/action" status: 202 len: 0 microversion: 2.1 time: 0.579966 Nov 19 03:23:21.475938 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 287/549] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:20 2021] POST /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:23:21.483519 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e02a99cb-9cda-4137-a543-f62b3b0faafb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:21.484118 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e02a99cb-9cda-4137-a543-f62b3b0faafb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:21.491530 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e02a99cb-9cda-4137-a543-f62b3b0faafb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:21.491979 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e02a99cb-9cda-4137-a543-f62b3b0faafb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:21.492759 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e02a99cb-9cda-4137-a543-f62b3b0faafb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:21.493296 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e02a99cb-9cda-4137-a543-f62b3b0faafb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:21.661637 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6ff9f60c-16dd-4b84-ae2d-2309d4fde879 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28479 microversion: 2.1 time: 0.243955 Nov 19 03:23:21.662287 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 263/550] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:21 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28479 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:23:21.662658 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e02a99cb-9cda-4137-a543-f62b3b0faafb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:21.672370 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e02a99cb-9cda-4137-a543-f62b3b0faafb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1761 microversion: 2.1 time: 0.192316 Nov 19 03:23:21.673034 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 288/551] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:21 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1761 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:21.810829 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-7055bc80-1160-46ae-9dc6-5343a311bd32 req-0793f864-dc0a-4044-b46b-d353e4f47ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140090bc-aacf-4ff7-8c49-35408b97f6f8", "tag": "4ad10a71-4d53-4076-951d-e0ce7c2cbf68"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:21.812396 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:23:21.812396 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:23:21.820281 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-7055bc80-1160-46ae-9dc6-5343a311bd32 req-0793f864-dc0a-4044-b46b-d353e4f47ba4 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:21.820758 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-7055bc80-1160-46ae-9dc6-5343a311bd32 req-0793f864-dc0a-4044-b46b-d353e4f47ba4 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:21.829878 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-471ae9d9-6e36-4844-a3d8-24a885135874 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:21.830988 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-471ae9d9-6e36-4844-a3d8-24a885135874 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:21.833057 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-7055bc80-1160-46ae-9dc6-5343a311bd32 req-0793f864-dc0a-4044-b46b-d353e4f47ba4 service nova] Creating event network-changed:4ad10a71-4d53-4076-951d-e0ce7c2cbf68 for instance 140090bc-aacf-4ff7-8c49-35408b97f6f8 on hv-cinder-81803 Nov 19 03:23:21.837194 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-471ae9d9-6e36-4844-a3d8-24a885135874 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:21.837713 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-471ae9d9-6e36-4844-a3d8-24a885135874 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:21.837874 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-7055bc80-1160-46ae-9dc6-5343a311bd32 req-0793f864-dc0a-4044-b46b-d353e4f47ba4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031489 Nov 19 03:23:21.839110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 264/552] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:23:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:21.839336 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-471ae9d9-6e36-4844-a3d8-24a885135874 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:21.839840 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-471ae9d9-6e36-4844-a3d8-24a885135874 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:21.870170 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-471ae9d9-6e36-4844-a3d8-24a885135874 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045252 Nov 19 03:23:21.870859 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 289/553] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:21 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:22.334418 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-54a8d639-ed47-4dc4-ae25-ad40348c9f0b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:22.335150 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-54a8d639-ed47-4dc4-ae25-ad40348c9f0b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:22.341070 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-54a8d639-ed47-4dc4-ae25-ad40348c9f0b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:22.341551 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-54a8d639-ed47-4dc4-ae25-ad40348c9f0b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:22.342546 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-54a8d639-ed47-4dc4-ae25-ad40348c9f0b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:22.343262 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-54a8d639-ed47-4dc4-ae25-ad40348c9f0b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:22.528819 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-54a8d639-ed47-4dc4-ae25-ad40348c9f0b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:22.536602 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-54a8d639-ed47-4dc4-ae25-ad40348c9f0b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:22.538081 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-54a8d639-ed47-4dc4-ae25-ad40348c9f0b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:22.539262 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-54a8d639-ed47-4dc4-ae25-ad40348c9f0b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1742 microversion: 2.20 time: 0.209350 Nov 19 03:23:22.539822 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 265/554] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:22 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1742 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:22.673520 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-bf990039-e977-4876-a5ac-fd76ad00a1c2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:22.674422 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-bf990039-e977-4876-a5ac-fd76ad00a1c2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:22.680697 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bf990039-e977-4876-a5ac-fd76ad00a1c2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:22.681135 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bf990039-e977-4876-a5ac-fd76ad00a1c2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:22.681895 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bf990039-e977-4876-a5ac-fd76ad00a1c2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:22.682322 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bf990039-e977-4876-a5ac-fd76ad00a1c2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:22.880965 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-487affd7-727e-4d4a-80c8-e1f5a035e340 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:22.881876 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-487affd7-727e-4d4a-80c8-e1f5a035e340 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:22.888173 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-487affd7-727e-4d4a-80c8-e1f5a035e340 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:22.888621 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-487affd7-727e-4d4a-80c8-e1f5a035e340 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:22.889541 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-487affd7-727e-4d4a-80c8-e1f5a035e340 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:22.889979 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-487affd7-727e-4d4a-80c8-e1f5a035e340 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:22.919255 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-487affd7-727e-4d4a-80c8-e1f5a035e340 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041944 Nov 19 03:23:22.919824 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 266/555] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:22 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:23:22.962146 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-bf990039-e977-4876-a5ac-fd76ad00a1c2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28541 microversion: 2.1 time: 0.292675 Nov 19 03:23:22.963119 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 290/556] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:22 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28541 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:23.563475 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e19a35f1-6848-46e6-8376-fd2d6f17e3f3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:23.564083 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e19a35f1-6848-46e6-8376-fd2d6f17e3f3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:23.570605 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e19a35f1-6848-46e6-8376-fd2d6f17e3f3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:23.571068 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e19a35f1-6848-46e6-8376-fd2d6f17e3f3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:23.571922 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e19a35f1-6848-46e6-8376-fd2d6f17e3f3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:23.572939 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e19a35f1-6848-46e6-8376-fd2d6f17e3f3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:23.719780 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e19a35f1-6848-46e6-8376-fd2d6f17e3f3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:23.728908 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e19a35f1-6848-46e6-8376-fd2d6f17e3f3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:23.730932 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e19a35f1-6848-46e6-8376-fd2d6f17e3f3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:23.732421 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e19a35f1-6848-46e6-8376-fd2d6f17e3f3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1737 microversion: 2.20 time: 0.172624 Nov 19 03:23:23.733469 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 267/557] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:23 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:23.932595 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e51b0876-559c-46d8-a6b0-1aa965d68580 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:23.934235 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e51b0876-559c-46d8-a6b0-1aa965d68580 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:23.941454 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e51b0876-559c-46d8-a6b0-1aa965d68580 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:23.941934 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e51b0876-559c-46d8-a6b0-1aa965d68580 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:23.942760 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e51b0876-559c-46d8-a6b0-1aa965d68580 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:23.943360 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e51b0876-559c-46d8-a6b0-1aa965d68580 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:23.976636 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-074a7d98-395a-4c28-aef9-519bbb82df1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:23.978396 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-074a7d98-395a-4c28-aef9-519bbb82df1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:23.979598 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e51b0876-559c-46d8-a6b0-1aa965d68580 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051678 Nov 19 03:23:23.983857 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 291/558] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:23 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:23.989316 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-074a7d98-395a-4c28-aef9-519bbb82df1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:23.989951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-074a7d98-395a-4c28-aef9-519bbb82df1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:23.991027 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-074a7d98-395a-4c28-aef9-519bbb82df1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:23.991594 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-074a7d98-395a-4c28-aef9-519bbb82df1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:24.147126 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-074a7d98-395a-4c28-aef9-519bbb82df1d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.176471 Nov 19 03:23:24.148286 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 268/559] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:23 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:24.750288 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e57f0953-c8ef-4cb6-b527-4eba50044cf8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:24.751308 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e57f0953-c8ef-4cb6-b527-4eba50044cf8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:24.760220 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e57f0953-c8ef-4cb6-b527-4eba50044cf8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:24.760631 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e57f0953-c8ef-4cb6-b527-4eba50044cf8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:24.761639 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e57f0953-c8ef-4cb6-b527-4eba50044cf8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:24.762240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e57f0953-c8ef-4cb6-b527-4eba50044cf8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:24.944714 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e57f0953-c8ef-4cb6-b527-4eba50044cf8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:24.954412 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e57f0953-c8ef-4cb6-b527-4eba50044cf8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:24.955934 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e57f0953-c8ef-4cb6-b527-4eba50044cf8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:24.957092 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e57f0953-c8ef-4cb6-b527-4eba50044cf8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1737 microversion: 2.20 time: 0.210874 Nov 19 03:23:24.958138 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 292/560] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:24 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:24.992871 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9bd7086a-2249-4d33-8c1b-05b32b42886e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:24.994168 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9bd7086a-2249-4d33-8c1b-05b32b42886e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:25.002560 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9bd7086a-2249-4d33-8c1b-05b32b42886e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:25.003464 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9bd7086a-2249-4d33-8c1b-05b32b42886e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:25.004531 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9bd7086a-2249-4d33-8c1b-05b32b42886e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:25.005190 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9bd7086a-2249-4d33-8c1b-05b32b42886e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:25.049030 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9bd7086a-2249-4d33-8c1b-05b32b42886e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060837 Nov 19 03:23:25.049975 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 269/561] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:24 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:25.160085 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8a370676-0ee2-4348-8c32-9692e27fd39e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:25.161003 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8a370676-0ee2-4348-8c32-9692e27fd39e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:25.169956 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8a370676-0ee2-4348-8c32-9692e27fd39e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:25.170670 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8a370676-0ee2-4348-8c32-9692e27fd39e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:25.172032 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8a370676-0ee2-4348-8c32-9692e27fd39e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:25.172443 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8a370676-0ee2-4348-8c32-9692e27fd39e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:25.288148 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8a370676-0ee2-4348-8c32-9692e27fd39e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.131004 Nov 19 03:23:25.296235 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 293/562] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:25 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:25.977289 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-51f8de2e-b69e-4d90-8620-89b4144f688a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:25.978227 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-51f8de2e-b69e-4d90-8620-89b4144f688a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:25.985968 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51f8de2e-b69e-4d90-8620-89b4144f688a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:25.986236 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-aa702567-34b2-45b1-a1d6-5762a6c3526d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:25.986804 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51f8de2e-b69e-4d90-8620-89b4144f688a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:25.986903 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-aa702567-34b2-45b1-a1d6-5762a6c3526d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:25.987492 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51f8de2e-b69e-4d90-8620-89b4144f688a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:25.988081 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-51f8de2e-b69e-4d90-8620-89b4144f688a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:25.993693 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-aa702567-34b2-45b1-a1d6-5762a6c3526d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:25.994141 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-aa702567-34b2-45b1-a1d6-5762a6c3526d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:25.995146 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-aa702567-34b2-45b1-a1d6-5762a6c3526d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:25.995746 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-aa702567-34b2-45b1-a1d6-5762a6c3526d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:26.100335 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-aa702567-34b2-45b1-a1d6-5762a6c3526d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lazy-loading 'services' on Instance uuid fcff5f64-47d5-42be-b3d9-178bc26dff6b {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:26.188475 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-51f8de2e-b69e-4d90-8620-89b4144f688a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:26.199143 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-51f8de2e-b69e-4d90-8620-89b4144f688a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:26.201169 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-51f8de2e-b69e-4d90-8620-89b4144f688a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:26.203065 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-51f8de2e-b69e-4d90-8620-89b4144f688a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1737 microversion: 2.20 time: 0.230351 Nov 19 03:23:26.214219 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 270/563] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:25 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:26.222056 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f07cf510-373d-4684-886b-716d8a2bc33c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:26.222804 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-aa702567-34b2-45b1-a1d6-5762a6c3526d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b/os-volume_attachments/ee92a730-a67a-497f-ac94-069addf4300a" status: 202 len: 0 microversion: 2.1 time: 0.242319 Nov 19 03:23:26.223410 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f07cf510-373d-4684-886b-716d8a2bc33c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:26.223718 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 294/564] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Nov 19 03:23:25 2021] DELETE /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b/os-volume_attachments/ee92a730-a67a-497f-ac94-069addf4300a => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:23:26.231161 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f07cf510-373d-4684-886b-716d8a2bc33c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:26.231856 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f07cf510-373d-4684-886b-716d8a2bc33c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:26.232303 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-868bb754-9571-4f0c-b8e1-f25b3d105b82 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:26.233556 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f07cf510-373d-4684-886b-716d8a2bc33c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:26.234214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-868bb754-9571-4f0c-b8e1-f25b3d105b82 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:26.234486 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f07cf510-373d-4684-886b-716d8a2bc33c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:26.250949 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-868bb754-9571-4f0c-b8e1-f25b3d105b82 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:26.253786 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-868bb754-9571-4f0c-b8e1-f25b3d105b82 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:26.255054 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-868bb754-9571-4f0c-b8e1-f25b3d105b82 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:26.256241 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-868bb754-9571-4f0c-b8e1-f25b3d105b82 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:26.300209 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-868bb754-9571-4f0c-b8e1-f25b3d105b82 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072276 Nov 19 03:23:26.301570 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 295/565] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:26 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:26.302506 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f07cf510-373d-4684-886b-716d8a2bc33c tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082850 Nov 19 03:23:26.303125 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 271/566] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:26 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:23:26.332365 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f2e9fdc9-6bf0-4ffb-8cea-5d0d093031df tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:26.333921 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f2e9fdc9-6bf0-4ffb-8cea-5d0d093031df tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:26.340391 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f2e9fdc9-6bf0-4ffb-8cea-5d0d093031df tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:26.341140 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f2e9fdc9-6bf0-4ffb-8cea-5d0d093031df tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:26.342979 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f2e9fdc9-6bf0-4ffb-8cea-5d0d093031df tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:26.344408 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f2e9fdc9-6bf0-4ffb-8cea-5d0d093031df tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:26.498130 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f2e9fdc9-6bf0-4ffb-8cea-5d0d093031df tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.195063 Nov 19 03:23:26.499114 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 296/567] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:26 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:27.225162 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ac2a6e0f-b068-4b37-b701-4a37e68960f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:27.226618 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ac2a6e0f-b068-4b37-b701-4a37e68960f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:27.233812 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ac2a6e0f-b068-4b37-b701-4a37e68960f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:27.234356 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ac2a6e0f-b068-4b37-b701-4a37e68960f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:27.235451 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ac2a6e0f-b068-4b37-b701-4a37e68960f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:27.235951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ac2a6e0f-b068-4b37-b701-4a37e68960f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:27.317948 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-baf34c1d-40fb-4927-ad78-061401dead6c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:27.320125 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-baf34c1d-40fb-4927-ad78-061401dead6c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:27.328391 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-baf34c1d-40fb-4927-ad78-061401dead6c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:27.329350 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-baf34c1d-40fb-4927-ad78-061401dead6c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:27.330545 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-baf34c1d-40fb-4927-ad78-061401dead6c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:27.331135 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-baf34c1d-40fb-4927-ad78-061401dead6c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:27.367418 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-baf34c1d-40fb-4927-ad78-061401dead6c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053791 Nov 19 03:23:27.368305 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 297/568] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:27 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:27.382974 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ac2a6e0f-b068-4b37-b701-4a37e68960f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:27.391799 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ac2a6e0f-b068-4b37-b701-4a37e68960f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:27.393391 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ac2a6e0f-b068-4b37-b701-4a37e68960f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:27.394596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ac2a6e0f-b068-4b37-b701-4a37e68960f8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1737 microversion: 2.20 time: 0.173314 Nov 19 03:23:27.395155 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 272/569] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:27 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:27.511070 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a103d7d3-8b4d-4e4a-86df-73af82d7e9e2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:27.512328 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a103d7d3-8b4d-4e4a-86df-73af82d7e9e2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:27.525050 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a103d7d3-8b4d-4e4a-86df-73af82d7e9e2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:27.526967 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a103d7d3-8b4d-4e4a-86df-73af82d7e9e2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:27.527791 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a103d7d3-8b4d-4e4a-86df-73af82d7e9e2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:27.528320 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a103d7d3-8b4d-4e4a-86df-73af82d7e9e2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:27.642802 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a103d7d3-8b4d-4e4a-86df-73af82d7e9e2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.135409 Nov 19 03:23:27.646678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 298/570] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:27 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:28.384248 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-16922b6f-1f50-4e27-a6ec-94c6d5c7006d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:28.385069 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-16922b6f-1f50-4e27-a6ec-94c6d5c7006d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:28.392313 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-16922b6f-1f50-4e27-a6ec-94c6d5c7006d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:28.392758 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-16922b6f-1f50-4e27-a6ec-94c6d5c7006d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:28.393532 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-16922b6f-1f50-4e27-a6ec-94c6d5c7006d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:28.393961 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-16922b6f-1f50-4e27-a6ec-94c6d5c7006d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:28.413299 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-abc31fd5-b194-4f82-af64-7bc15fb50ea1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:28.413993 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-abc31fd5-b194-4f82-af64-7bc15fb50ea1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:28.421342 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-abc31fd5-b194-4f82-af64-7bc15fb50ea1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:28.421792 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-abc31fd5-b194-4f82-af64-7bc15fb50ea1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:28.422619 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-abc31fd5-b194-4f82-af64-7bc15fb50ea1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:28.423058 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-abc31fd5-b194-4f82-af64-7bc15fb50ea1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:28.432943 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-16922b6f-1f50-4e27-a6ec-94c6d5c7006d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056549 Nov 19 03:23:28.433877 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 273/571] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:23:28 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:23:28.576944 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-abc31fd5-b194-4f82-af64-7bc15fb50ea1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:28.586850 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-abc31fd5-b194-4f82-af64-7bc15fb50ea1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:28.588863 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-abc31fd5-b194-4f82-af64-7bc15fb50ea1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:28.590491 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-abc31fd5-b194-4f82-af64-7bc15fb50ea1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1737 microversion: 2.20 time: 0.180930 Nov 19 03:23:28.591338 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 299/572] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:28 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:28.683342 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c028cd37-4481-4e67-ae56-7a4f5486c1ef tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:28.695595 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c028cd37-4481-4e67-ae56-7a4f5486c1ef tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:28.697079 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0a75bdf2-e617-458a-bfe4-64d587b317db tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:28.697888 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0a75bdf2-e617-458a-bfe4-64d587b317db tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:28.704040 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c028cd37-4481-4e67-ae56-7a4f5486c1ef tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:28.704492 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c028cd37-4481-4e67-ae56-7a4f5486c1ef tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:28.705285 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c028cd37-4481-4e67-ae56-7a4f5486c1ef tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:28.705715 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c028cd37-4481-4e67-ae56-7a4f5486c1ef tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:28.705948 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a75bdf2-e617-458a-bfe4-64d587b317db tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:28.707045 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a75bdf2-e617-458a-bfe4-64d587b317db tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:28.708220 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a75bdf2-e617-458a-bfe4-64d587b317db tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:28.708828 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a75bdf2-e617-458a-bfe4-64d587b317db tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:28.743803 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0a75bdf2-e617-458a-bfe4-64d587b317db tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Going to try to terminate instance {{(pid=116065) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:23:28.833266 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c028cd37-4481-4e67-ae56-7a4f5486c1ef tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.181687 Nov 19 03:23:28.837932 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 274/573] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:28 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:28.841056 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0a75bdf2-e617-458a-bfe4-64d587b317db tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 204 len: 0 microversion: 2.1 time: 0.147633 Nov 19 03:23:28.842301 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 300/574] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:23:28 2021] DELETE /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 03:23:28.852405 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6e4d6c74-15ed-4f63-8b2f-0fa25a9a7dd6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:28.853186 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6e4d6c74-15ed-4f63-8b2f-0fa25a9a7dd6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:28.860894 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e4d6c74-15ed-4f63-8b2f-0fa25a9a7dd6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:28.861335 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e4d6c74-15ed-4f63-8b2f-0fa25a9a7dd6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:28.862110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e4d6c74-15ed-4f63-8b2f-0fa25a9a7dd6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:28.862561 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e4d6c74-15ed-4f63-8b2f-0fa25a9a7dd6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:29.044805 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-6e4d6c74-15ed-4f63-8b2f-0fa25a9a7dd6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:29.054389 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6e4d6c74-15ed-4f63-8b2f-0fa25a9a7dd6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1509 microversion: 2.1 time: 0.208044 Nov 19 03:23:29.055177 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 275/575] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:28 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:29.609762 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-edefc439-905f-4e0d-8229-cc6c74270d88 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:29.611237 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-edefc439-905f-4e0d-8229-cc6c74270d88 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:29.618807 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-edefc439-905f-4e0d-8229-cc6c74270d88 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:29.619372 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-edefc439-905f-4e0d-8229-cc6c74270d88 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:29.620424 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-edefc439-905f-4e0d-8229-cc6c74270d88 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:29.620965 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-edefc439-905f-4e0d-8229-cc6c74270d88 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:29.725315 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-964fbef7-50b4-4d30-ba47-ac24c06ac9f9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:29.725875 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-964fbef7-50b4-4d30-ba47-ac24c06ac9f9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:29.745436 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-964fbef7-50b4-4d30-ba47-ac24c06ac9f9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:29.746277 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-964fbef7-50b4-4d30-ba47-ac24c06ac9f9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:29.752747 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-964fbef7-50b4-4d30-ba47-ac24c06ac9f9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:29.753470 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-964fbef7-50b4-4d30-ba47-ac24c06ac9f9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:29.789323 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-964fbef7-50b4-4d30-ba47-ac24c06ac9f9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Going to try to terminate instance {{(pid=116066) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:23:29.797252 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-edefc439-905f-4e0d-8229-cc6c74270d88 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:29.813885 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-edefc439-905f-4e0d-8229-cc6c74270d88 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:29.816514 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-edefc439-905f-4e0d-8229-cc6c74270d88 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:29.817692 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-edefc439-905f-4e0d-8229-cc6c74270d88 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1737 microversion: 2.20 time: 0.212269 Nov 19 03:23:29.818423 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 301/576] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:29 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:23:29.846188 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6aad500b-b0c1-4e4b-b710-3a17e590fa4c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:29.847204 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6aad500b-b0c1-4e4b-b710-3a17e590fa4c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:29.856648 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6aad500b-b0c1-4e4b-b710-3a17e590fa4c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:29.857319 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6aad500b-b0c1-4e4b-b710-3a17e590fa4c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:29.858610 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6aad500b-b0c1-4e4b-b710-3a17e590fa4c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:29.859210 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6aad500b-b0c1-4e4b-b710-3a17e590fa4c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:29.883503 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-964fbef7-50b4-4d30-ba47-ac24c06ac9f9 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 204 len: 0 microversion: 2.1 time: 0.170909 Nov 19 03:23:29.884462 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 276/577] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:23:29 2021] DELETE /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:23:29.894877 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9d2ae6b8-1ae2-468f-94c2-c9c8efa2f8af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:29.895680 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9d2ae6b8-1ae2-468f-94c2-c9c8efa2f8af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:29.901758 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9d2ae6b8-1ae2-468f-94c2-c9c8efa2f8af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:29.902212 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9d2ae6b8-1ae2-468f-94c2-c9c8efa2f8af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:29.903052 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9d2ae6b8-1ae2-468f-94c2-c9c8efa2f8af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:29.903535 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9d2ae6b8-1ae2-468f-94c2-c9c8efa2f8af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:30.056994 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6aad500b-b0c1-4e4b-b710-3a17e590fa4c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.214644 Nov 19 03:23:30.060571 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 302/578] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:29 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:30.080693 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-51c94149-910c-4efd-88ec-15389296e8d9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:30.082108 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-51c94149-910c-4efd-88ec-15389296e8d9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:30.106503 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51c94149-910c-4efd-88ec-15389296e8d9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:30.107473 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51c94149-910c-4efd-88ec-15389296e8d9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:30.109144 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51c94149-910c-4efd-88ec-15389296e8d9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:30.109824 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51c94149-910c-4efd-88ec-15389296e8d9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:30.135795 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-9d2ae6b8-1ae2-468f-94c2-c9c8efa2f8af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:30.157759 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9d2ae6b8-1ae2-468f-94c2-c9c8efa2f8af tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1515 microversion: 2.1 time: 0.268584 Nov 19 03:23:30.158631 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 277/579] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:29 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1515 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:30.293177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-51c94149-910c-4efd-88ec-15389296e8d9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:30.300876 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-51c94149-910c-4efd-88ec-15389296e8d9 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1509 microversion: 2.1 time: 0.232680 Nov 19 03:23:30.301434 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 303/580] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:30 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:30.837969 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b93b3720-60ce-4fe8-b313-320000c949b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:30.839400 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b93b3720-60ce-4fe8-b313-320000c949b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:30.847755 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b93b3720-60ce-4fe8-b313-320000c949b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:30.848285 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b93b3720-60ce-4fe8-b313-320000c949b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:30.849310 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b93b3720-60ce-4fe8-b313-320000c949b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:30.849874 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b93b3720-60ce-4fe8-b313-320000c949b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:30.996415 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b93b3720-60ce-4fe8-b313-320000c949b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:31.005969 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b93b3720-60ce-4fe8-b313-320000c949b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:31.007464 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b93b3720-60ce-4fe8-b313-320000c949b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:31.008604 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b93b3720-60ce-4fe8-b313-320000c949b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1737 microversion: 2.20 time: 0.175164 Nov 19 03:23:31.009162 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 278/581] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:30 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:31.078322 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1d6783fb-05c9-4a3e-8ae8-730db7b07480 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:31.079925 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1d6783fb-05c9-4a3e-8ae8-730db7b07480 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:31.087101 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1d6783fb-05c9-4a3e-8ae8-730db7b07480 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:31.088437 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1d6783fb-05c9-4a3e-8ae8-730db7b07480 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:31.088437 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1d6783fb-05c9-4a3e-8ae8-730db7b07480 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:31.089088 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1d6783fb-05c9-4a3e-8ae8-730db7b07480 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:31.178041 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-44461159-8e5b-4864-8264-4fefb3d10c99 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:31.178921 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-44461159-8e5b-4864-8264-4fefb3d10c99 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:31.185382 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-44461159-8e5b-4864-8264-4fefb3d10c99 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:31.186076 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-44461159-8e5b-4864-8264-4fefb3d10c99 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:31.186886 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-44461159-8e5b-4864-8264-4fefb3d10c99 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:31.187319 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-44461159-8e5b-4864-8264-4fefb3d10c99 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:31.215678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1d6783fb-05c9-4a3e-8ae8-730db7b07480 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.145666 Nov 19 03:23:31.216562 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 304/582] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:31 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:31.318035 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-beed7a78-a648-415d-bd87-b906bd34f03a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:31.319055 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-beed7a78-a648-415d-bd87-b906bd34f03a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:31.326376 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-beed7a78-a648-415d-bd87-b906bd34f03a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:31.327311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-beed7a78-a648-415d-bd87-b906bd34f03a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:31.328262 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-beed7a78-a648-415d-bd87-b906bd34f03a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:31.328888 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-beed7a78-a648-415d-bd87-b906bd34f03a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:31.368944 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-44461159-8e5b-4864-8264-4fefb3d10c99 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:31.377798 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-44461159-8e5b-4864-8264-4fefb3d10c99 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1515 microversion: 2.1 time: 0.204291 Nov 19 03:23:31.378977 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 279/583] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:31 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:31.492633 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-beed7a78-a648-415d-bd87-b906bd34f03a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:31.501488 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-beed7a78-a648-415d-bd87-b906bd34f03a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1509 microversion: 2.1 time: 0.187418 Nov 19 03:23:31.502510 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 305/584] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:31 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:32.027170 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e64c34f2-3367-44b9-a438-836c679ca616 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:32.027776 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e64c34f2-3367-44b9-a438-836c679ca616 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:32.033788 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e64c34f2-3367-44b9-a438-836c679ca616 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:32.034556 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e64c34f2-3367-44b9-a438-836c679ca616 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:32.035398 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e64c34f2-3367-44b9-a438-836c679ca616 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:32.035890 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e64c34f2-3367-44b9-a438-836c679ca616 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:32.199394 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e64c34f2-3367-44b9-a438-836c679ca616 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:32.208614 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e64c34f2-3367-44b9-a438-836c679ca616 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:32.210130 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e64c34f2-3367-44b9-a438-836c679ca616 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:32.211315 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e64c34f2-3367-44b9-a438-836c679ca616 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1737 microversion: 2.20 time: 0.188093 Nov 19 03:23:32.211876 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 280/585] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:32 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:32.228233 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5736e48b-686d-46eb-ae3d-fd8dbbf7336a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:32.229454 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5736e48b-686d-46eb-ae3d-fd8dbbf7336a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:32.236045 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5736e48b-686d-46eb-ae3d-fd8dbbf7336a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:32.236591 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5736e48b-686d-46eb-ae3d-fd8dbbf7336a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:32.237450 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5736e48b-686d-46eb-ae3d-fd8dbbf7336a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:32.237982 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5736e48b-686d-46eb-ae3d-fd8dbbf7336a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:32.401241 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-88d98a33-5d2c-43cd-9575-0ac2d1ede53d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:32.402019 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-88d98a33-5d2c-43cd-9575-0ac2d1ede53d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:32.414908 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-88d98a33-5d2c-43cd-9575-0ac2d1ede53d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:32.415403 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-88d98a33-5d2c-43cd-9575-0ac2d1ede53d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:32.416196 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-88d98a33-5d2c-43cd-9575-0ac2d1ede53d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:32.416637 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-88d98a33-5d2c-43cd-9575-0ac2d1ede53d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:32.423321 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5736e48b-686d-46eb-ae3d-fd8dbbf7336a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.197995 Nov 19 03:23:32.424593 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 306/586] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:32 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:32.522092 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4ca2fe9d-ae8c-4d6e-84c0-ca7e1eb36f79 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:32.523135 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4ca2fe9d-ae8c-4d6e-84c0-ca7e1eb36f79 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:32.534770 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4ca2fe9d-ae8c-4d6e-84c0-ca7e1eb36f79 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:32.536501 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4ca2fe9d-ae8c-4d6e-84c0-ca7e1eb36f79 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:32.536501 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4ca2fe9d-ae8c-4d6e-84c0-ca7e1eb36f79 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:32.536501 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4ca2fe9d-ae8c-4d6e-84c0-ca7e1eb36f79 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:32.606557 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-88d98a33-5d2c-43cd-9575-0ac2d1ede53d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:32.615211 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-88d98a33-5d2c-43cd-9575-0ac2d1ede53d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1515 microversion: 2.1 time: 0.219647 Nov 19 03:23:32.622833 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 281/587] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:32 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:32.733113 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4ca2fe9d-ae8c-4d6e-84c0-ca7e1eb36f79 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:32.743789 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4ca2fe9d-ae8c-4d6e-84c0-ca7e1eb36f79 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1509 microversion: 2.1 time: 0.225720 Nov 19 03:23:32.754695 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 307/588] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:32 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:33.233390 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-663d3a63-4511-4676-9ecf-9b190a1f1e81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:33.234947 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-663d3a63-4511-4676-9ecf-9b190a1f1e81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:33.241813 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-663d3a63-4511-4676-9ecf-9b190a1f1e81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:33.242561 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-663d3a63-4511-4676-9ecf-9b190a1f1e81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:33.243345 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-663d3a63-4511-4676-9ecf-9b190a1f1e81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:33.243775 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-663d3a63-4511-4676-9ecf-9b190a1f1e81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:33.438361 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-dccef729-fe59-4153-9110-85f853f7d136 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:33.439342 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-dccef729-fe59-4153-9110-85f853f7d136 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:33.455615 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dccef729-fe59-4153-9110-85f853f7d136 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:33.461773 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dccef729-fe59-4153-9110-85f853f7d136 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:33.462817 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dccef729-fe59-4153-9110-85f853f7d136 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:33.467207 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dccef729-fe59-4153-9110-85f853f7d136 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:33.495494 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-663d3a63-4511-4676-9ecf-9b190a1f1e81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:33.519001 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-663d3a63-4511-4676-9ecf-9b190a1f1e81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:33.520679 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-663d3a63-4511-4676-9ecf-9b190a1f1e81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:33.523021 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-663d3a63-4511-4676-9ecf-9b190a1f1e81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1737 microversion: 2.20 time: 0.296398 Nov 19 03:23:33.524997 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 282/589] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:33 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1737 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:33.590766 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-dccef729-fe59-4153-9110-85f853f7d136 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.158366 Nov 19 03:23:33.592563 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 308/590] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:33 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:33.641433 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-711b6b11-9826-44e7-ae33-c691805c387a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:33.642257 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-711b6b11-9826-44e7-ae33-c691805c387a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:33.655726 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-711b6b11-9826-44e7-ae33-c691805c387a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:33.656029 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-711b6b11-9826-44e7-ae33-c691805c387a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:33.658142 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-711b6b11-9826-44e7-ae33-c691805c387a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:33.660011 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-711b6b11-9826-44e7-ae33-c691805c387a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:33.679109 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-cf238c7e-5dfb-4677-a36c-34775f9ac3d5 req-78352cbb-5733-4846-93e6-9284af63ce65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8", "name": "network-vif-deleted", "tag": "0fcea7e8-8abe-4c82-990b-b3b5386e6d48"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:33.680191 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:23:33.680191 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:23:33.690852 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-cf238c7e-5dfb-4677-a36c-34775f9ac3d5 req-78352cbb-5733-4846-93e6-9284af63ce65 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:33.691344 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-cf238c7e-5dfb-4677-a36c-34775f9ac3d5 req-78352cbb-5733-4846-93e6-9284af63ce65 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:33.737214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-cf238c7e-5dfb-4677-a36c-34775f9ac3d5 req-78352cbb-5733-4846-93e6-9284af63ce65 service nova] Creating event network-vif-deleted:0fcea7e8-8abe-4c82-990b-b3b5386e6d48 for instance 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 on hv-cinder-81803 Nov 19 03:23:33.751651 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-cf238c7e-5dfb-4677-a36c-34775f9ac3d5 req-78352cbb-5733-4846-93e6-9284af63ce65 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078399 Nov 19 03:23:33.754144 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 309/591] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:23:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:23:33.770318 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1f69560f-46a5-47c5-b33c-0cec1fcc2218 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:33.771392 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1f69560f-46a5-47c5-b33c-0cec1fcc2218 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:33.790132 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1f69560f-46a5-47c5-b33c-0cec1fcc2218 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:33.790951 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1f69560f-46a5-47c5-b33c-0cec1fcc2218 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:33.792513 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1f69560f-46a5-47c5-b33c-0cec1fcc2218 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:33.794699 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1f69560f-46a5-47c5-b33c-0cec1fcc2218 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:33.925712 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1f69560f-46a5-47c5-b33c-0cec1fcc2218 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:33.933735 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1f69560f-46a5-47c5-b33c-0cec1fcc2218 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 200 len: 1293 microversion: 2.1 time: 0.173465 Nov 19 03:23:33.934876 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 310/592] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:33 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 1293 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:33.961340 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-711b6b11-9826-44e7-ae33-c691805c387a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:33.974354 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-711b6b11-9826-44e7-ae33-c691805c387a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1515 microversion: 2.1 time: 0.337924 Nov 19 03:23:33.984572 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 283/593] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:33 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1515 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:33.988263 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-f5699445-51a8-473f-8107-d4348995865d req-d0796c29-1ca8-4545-8c24-c736c1dfb76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcff5f64-47d5-42be-b3d9-178bc26dff6b", "name": "network-vif-deleted", "tag": "acf6de7e-c417-4238-b1f6-5062a513bfba"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:33.990297 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:23:33.990297 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:23:33.997997 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-f5699445-51a8-473f-8107-d4348995865d req-d0796c29-1ca8-4545-8c24-c736c1dfb76c service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:33.998710 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-f5699445-51a8-473f-8107-d4348995865d req-d0796c29-1ca8-4545-8c24-c736c1dfb76c service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:34.012843 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-f5699445-51a8-473f-8107-d4348995865d req-d0796c29-1ca8-4545-8c24-c736c1dfb76c service nova] Creating event network-vif-deleted:acf6de7e-c417-4238-b1f6-5062a513bfba for instance fcff5f64-47d5-42be-b3d9-178bc26dff6b on hv-cinder-81803 Nov 19 03:23:34.019895 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-f5699445-51a8-473f-8107-d4348995865d req-d0796c29-1ca8-4545-8c24-c736c1dfb76c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035182 Nov 19 03:23:34.021396 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 311/594] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:23:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:23:34.541193 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b432206b-8f7b-4d60-8dc2-b662e56166b9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:34.541802 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b432206b-8f7b-4d60-8dc2-b662e56166b9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:34.549049 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b432206b-8f7b-4d60-8dc2-b662e56166b9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:34.549486 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b432206b-8f7b-4d60-8dc2-b662e56166b9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:34.550267 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b432206b-8f7b-4d60-8dc2-b662e56166b9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:34.550722 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b432206b-8f7b-4d60-8dc2-b662e56166b9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:34.603951 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3383c9cc-8027-48e0-b813-280b5d7a5b04 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:34.605047 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3383c9cc-8027-48e0-b813-280b5d7a5b04 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:34.622037 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3383c9cc-8027-48e0-b813-280b5d7a5b04 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:34.622549 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3383c9cc-8027-48e0-b813-280b5d7a5b04 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:34.623951 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3383c9cc-8027-48e0-b813-280b5d7a5b04 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:34.624480 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3383c9cc-8027-48e0-b813-280b5d7a5b04 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:34.708802 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b432206b-8f7b-4d60-8dc2-b662e56166b9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:34.718022 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b432206b-8f7b-4d60-8dc2-b662e56166b9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:34.719503 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b432206b-8f7b-4d60-8dc2-b662e56166b9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:34.720642 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b432206b-8f7b-4d60-8dc2-b662e56166b9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1737 microversion: 2.20 time: 0.183309 Nov 19 03:23:34.721195 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 284/595] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:34 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:34.898096 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3383c9cc-8027-48e0-b813-280b5d7a5b04 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.298270 Nov 19 03:23:34.898919 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 312/596] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:34 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:23:34.950344 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4bf71a9b-e160-49db-97d9-e2d5c64f5410 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:34.951064 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4bf71a9b-e160-49db-97d9-e2d5c64f5410 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:34.957753 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4bf71a9b-e160-49db-97d9-e2d5c64f5410 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:34.958195 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4bf71a9b-e160-49db-97d9-e2d5c64f5410 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:34.958991 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4bf71a9b-e160-49db-97d9-e2d5c64f5410 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:34.959415 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4bf71a9b-e160-49db-97d9-e2d5c64f5410 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:34.972938 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-4bf71a9b-e160-49db-97d9-e2d5c64f5410 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] HTTP exception thrown: Instance 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 could not be found. Nov 19 03:23:34.973514 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4bf71a9b-e160-49db-97d9-e2d5c64f5410 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Returning 404 to user: Instance 3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:23:34.974327 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4bf71a9b-e160-49db-97d9-e2d5c64f5410 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8" status: 404 len: 111 microversion: 2.1 time: 0.027842 Nov 19 03:23:34.974885 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 285/597] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:34 2021] GET /compute/v2.1/servers/3f4ce89c-3b23-497c-aa6f-bfde3fabcbc8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:23:34.983343 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a430d915-bf61-4ea5-9b30-6128095ffe83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:34.983939 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a430d915-bf61-4ea5-9b30-6128095ffe83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:34.990917 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a430d915-bf61-4ea5-9b30-6128095ffe83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:34.991374 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a430d915-bf61-4ea5-9b30-6128095ffe83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:34.992231 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a430d915-bf61-4ea5-9b30-6128095ffe83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:34.992948 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-aa1bed3f-6a34-47be-a2bc-08996e370c5f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:34.993307 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a430d915-bf61-4ea5-9b30-6128095ffe83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:34.993665 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-aa1bed3f-6a34-47be-a2bc-08996e370c5f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:35.000205 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aa1bed3f-6a34-47be-a2bc-08996e370c5f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:35.000646 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aa1bed3f-6a34-47be-a2bc-08996e370c5f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:35.001427 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aa1bed3f-6a34-47be-a2bc-08996e370c5f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:35.002052 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aa1bed3f-6a34-47be-a2bc-08996e370c5f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:35.026262 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a430d915-bf61-4ea5-9b30-6128095ffe83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Going to try to terminate instance {{(pid=116065) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:23:35.033297 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aa1bed3f-6a34-47be-a2bc-08996e370c5f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:35.033745 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-aa1bed3f-6a34-47be-a2bc-08996e370c5f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:35.034191 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.objects.instance [None req-aa1bed3f-6a34-47be-a2bc-08996e370c5f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lazy-loading 'fault' on Instance uuid fcff5f64-47d5-42be-b3d9-178bc26dff6b {{(pid=116066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:35.077048 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-aa1bed3f-6a34-47be-a2bc-08996e370c5f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:35.084658 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-aa1bed3f-6a34-47be-a2bc-08996e370c5f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 200 len: 1308 microversion: 2.1 time: 0.095317 Nov 19 03:23:35.085228 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 286/598] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:34 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:35.101515 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a430d915-bf61-4ea5-9b30-6128095ffe83 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 204 len: 0 microversion: 2.1 time: 0.122074 Nov 19 03:23:35.102084 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 313/599] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:23:34 2021] DELETE /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:23:35.109757 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-73f125da-c413-48b6-a8cf-aeaf392066a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:35.110364 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-73f125da-c413-48b6-a8cf-aeaf392066a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:35.116289 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73f125da-c413-48b6-a8cf-aeaf392066a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:35.116733 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73f125da-c413-48b6-a8cf-aeaf392066a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:35.117516 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73f125da-c413-48b6-a8cf-aeaf392066a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:35.117954 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73f125da-c413-48b6-a8cf-aeaf392066a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:35.252865 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-73f125da-c413-48b6-a8cf-aeaf392066a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:35.260161 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-73f125da-c413-48b6-a8cf-aeaf392066a8 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.154040 Nov 19 03:23:35.260726 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 287/600] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:35 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:35.738885 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c659c849-32f3-485d-af70-daff170e1c8a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:35.739632 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c659c849-32f3-485d-af70-daff170e1c8a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:35.745466 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c659c849-32f3-485d-af70-daff170e1c8a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:35.745924 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c659c849-32f3-485d-af70-daff170e1c8a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:35.746767 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c659c849-32f3-485d-af70-daff170e1c8a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:35.747197 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c659c849-32f3-485d-af70-daff170e1c8a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:35.880105 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c659c849-32f3-485d-af70-daff170e1c8a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:35.887800 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c659c849-32f3-485d-af70-daff170e1c8a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:35.889843 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c659c849-32f3-485d-af70-daff170e1c8a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:35.891239 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c659c849-32f3-485d-af70-daff170e1c8a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1719 microversion: 2.20 time: 0.156397 Nov 19 03:23:35.891819 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 314/601] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:35 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:35.908921 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5d075166-1d9a-42e9-bffe-ce09f7521da6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:35.909957 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5d075166-1d9a-42e9-bffe-ce09f7521da6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:35.916446 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5d075166-1d9a-42e9-bffe-ce09f7521da6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:35.916886 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5d075166-1d9a-42e9-bffe-ce09f7521da6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:35.917654 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5d075166-1d9a-42e9-bffe-ce09f7521da6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:35.918081 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5d075166-1d9a-42e9-bffe-ce09f7521da6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:36.015567 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5d075166-1d9a-42e9-bffe-ce09f7521da6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.109855 Nov 19 03:23:36.016486 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 288/602] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:35 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:36.100859 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-54a8a3ab-31b7-4d7d-8c52-6995ffb70ebf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:36.101476 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-54a8a3ab-31b7-4d7d-8c52-6995ffb70ebf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: fcff5f64-47d5-42be-b3d9-178bc26dff6b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:36.107368 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-54a8a3ab-31b7-4d7d-8c52-6995ffb70ebf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:36.108487 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-54a8a3ab-31b7-4d7d-8c52-6995ffb70ebf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:36.109276 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-54a8a3ab-31b7-4d7d-8c52-6995ffb70ebf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:36.109716 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-54a8a3ab-31b7-4d7d-8c52-6995ffb70ebf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:36.123865 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-54a8a3ab-31b7-4d7d-8c52-6995ffb70ebf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] HTTP exception thrown: Instance fcff5f64-47d5-42be-b3d9-178bc26dff6b could not be found. Nov 19 03:23:36.124395 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-54a8a3ab-31b7-4d7d-8c52-6995ffb70ebf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Returning 404 to user: Instance fcff5f64-47d5-42be-b3d9-178bc26dff6b could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:23:36.125218 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-54a8a3ab-31b7-4d7d-8c52-6995ffb70ebf tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b" status: 404 len: 111 microversion: 2.1 time: 0.028029 Nov 19 03:23:36.125972 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 315/603] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:36 2021] GET /compute/v2.1/servers/fcff5f64-47d5-42be-b3d9-178bc26dff6b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:23:36.277884 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-086f2504-488b-495e-955d-8c1131a81f9b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:36.278498 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-086f2504-488b-495e-955d-8c1131a81f9b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:36.285204 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-086f2504-488b-495e-955d-8c1131a81f9b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:36.285645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-086f2504-488b-495e-955d-8c1131a81f9b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:36.286406 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-086f2504-488b-495e-955d-8c1131a81f9b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:36.286856 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-086f2504-488b-495e-955d-8c1131a81f9b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:36.418711 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-086f2504-488b-495e-955d-8c1131a81f9b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:36.427162 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-086f2504-488b-495e-955d-8c1131a81f9b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.153645 Nov 19 03:23:36.427726 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 289/604] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:36 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:36.909732 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f3e2473f-948c-44e6-85b7-8813907e262b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:36.910337 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f3e2473f-948c-44e6-85b7-8813907e262b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:36.916605 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3e2473f-948c-44e6-85b7-8813907e262b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:36.916989 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3e2473f-948c-44e6-85b7-8813907e262b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:36.917746 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3e2473f-948c-44e6-85b7-8813907e262b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:36.918174 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3e2473f-948c-44e6-85b7-8813907e262b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:37.027147 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-94381773-e4f6-4db8-a710-40eb95b211ea tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:37.028110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-94381773-e4f6-4db8-a710-40eb95b211ea tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:37.034985 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-94381773-e4f6-4db8-a710-40eb95b211ea tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:37.035434 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-94381773-e4f6-4db8-a710-40eb95b211ea tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:37.036221 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-94381773-e4f6-4db8-a710-40eb95b211ea tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:37.036655 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-94381773-e4f6-4db8-a710-40eb95b211ea tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:37.045588 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f3e2473f-948c-44e6-85b7-8813907e262b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:37.053410 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f3e2473f-948c-44e6-85b7-8813907e262b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:37.054987 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f3e2473f-948c-44e6-85b7-8813907e262b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:37.056136 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f3e2473f-948c-44e6-85b7-8813907e262b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1719 microversion: 2.20 time: 0.150919 Nov 19 03:23:37.062701 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 316/605] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:36 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:37.147677 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-94381773-e4f6-4db8-a710-40eb95b211ea tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.124207 Nov 19 03:23:37.148386 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 290/606] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:37 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:23:37.253717 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1f6ff84a-f10c-4f33-b0f1-d08084065568 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:37.254218 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1f6ff84a-f10c-4f33-b0f1-d08084065568 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:37.259996 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1f6ff84a-f10c-4f33-b0f1-d08084065568 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:37.260449 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1f6ff84a-f10c-4f33-b0f1-d08084065568 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:37.261217 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1f6ff84a-f10c-4f33-b0f1-d08084065568 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:37.261649 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1f6ff84a-f10c-4f33-b0f1-d08084065568 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:37.285918 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1f6ff84a-f10c-4f33-b0f1-d08084065568 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Going to try to terminate instance {{(pid=116065) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:23:37.361066 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1f6ff84a-f10c-4f33-b0f1-d08084065568 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 204 len: 0 microversion: 2.1 time: 0.111187 Nov 19 03:23:37.361832 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 317/607] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:23:37 2021] DELETE /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 03:23:37.371408 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cf8a8a20-6150-4fb3-b7b6-9e162b733eeb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:37.372243 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-cf8a8a20-6150-4fb3-b7b6-9e162b733eeb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:37.380340 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf8a8a20-6150-4fb3-b7b6-9e162b733eeb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:37.380831 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf8a8a20-6150-4fb3-b7b6-9e162b733eeb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:37.381747 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf8a8a20-6150-4fb3-b7b6-9e162b733eeb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:37.382183 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf8a8a20-6150-4fb3-b7b6-9e162b733eeb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:37.444529 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4e1d72fc-4afc-4c10-9e55-acda9797e900 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:37.445232 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4e1d72fc-4afc-4c10-9e55-acda9797e900 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:37.451495 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e1d72fc-4afc-4c10-9e55-acda9797e900 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:37.452079 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e1d72fc-4afc-4c10-9e55-acda9797e900 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:37.452884 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e1d72fc-4afc-4c10-9e55-acda9797e900 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:37.453324 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e1d72fc-4afc-4c10-9e55-acda9797e900 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:37.540266 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-cf8a8a20-6150-4fb3-b7b6-9e162b733eeb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:37.548586 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cf8a8a20-6150-4fb3-b7b6-9e162b733eeb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1515 microversion: 2.1 time: 0.181983 Nov 19 03:23:37.549158 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 291/608] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:37 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:37.607270 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4e1d72fc-4afc-4c10-9e55-acda9797e900 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:37.615439 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4e1d72fc-4afc-4c10-9e55-acda9797e900 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.174974 Nov 19 03:23:37.616276 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 318/609] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:37 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:38.074027 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3a06ea4b-64f5-403d-a696-f67cad304577 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:38.074828 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3a06ea4b-64f5-403d-a696-f67cad304577 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:38.081599 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3a06ea4b-64f5-403d-a696-f67cad304577 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:38.082045 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3a06ea4b-64f5-403d-a696-f67cad304577 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:38.082845 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3a06ea4b-64f5-403d-a696-f67cad304577 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:38.083275 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3a06ea4b-64f5-403d-a696-f67cad304577 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:38.160079 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-94a6a848-db02-4fec-8a6a-2a93b870f175 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:38.161465 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-94a6a848-db02-4fec-8a6a-2a93b870f175 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:38.167165 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-94a6a848-db02-4fec-8a6a-2a93b870f175 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:38.167688 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-94a6a848-db02-4fec-8a6a-2a93b870f175 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:38.168469 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-94a6a848-db02-4fec-8a6a-2a93b870f175 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:38.168906 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-94a6a848-db02-4fec-8a6a-2a93b870f175 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:38.213132 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-3a06ea4b-64f5-403d-a696-f67cad304577 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:38.220739 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-3a06ea4b-64f5-403d-a696-f67cad304577 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:38.222210 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-3a06ea4b-64f5-403d-a696-f67cad304577 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:38.223368 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3a06ea4b-64f5-403d-a696-f67cad304577 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1719 microversion: 2.20 time: 0.152986 Nov 19 03:23:38.223922 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 292/610] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:38 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:38.265958 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-94a6a848-db02-4fec-8a6a-2a93b870f175 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.109325 Nov 19 03:23:38.266596 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 319/611] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:38 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:38.565592 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-65228ebc-5eee-48cf-9150-faadfb2d2e09 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:38.566181 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-65228ebc-5eee-48cf-9150-faadfb2d2e09 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:38.573499 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-65228ebc-5eee-48cf-9150-faadfb2d2e09 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:38.573939 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-65228ebc-5eee-48cf-9150-faadfb2d2e09 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:38.575209 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-65228ebc-5eee-48cf-9150-faadfb2d2e09 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:38.575710 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-65228ebc-5eee-48cf-9150-faadfb2d2e09 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:38.632548 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b6d8b8b8-86b7-4c03-a040-3e1e8e9310b6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:38.633244 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b6d8b8b8-86b7-4c03-a040-3e1e8e9310b6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:38.640646 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b6d8b8b8-86b7-4c03-a040-3e1e8e9310b6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:38.641095 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b6d8b8b8-86b7-4c03-a040-3e1e8e9310b6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:38.641883 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b6d8b8b8-86b7-4c03-a040-3e1e8e9310b6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:38.642319 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b6d8b8b8-86b7-4c03-a040-3e1e8e9310b6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:38.741114 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-65228ebc-5eee-48cf-9150-faadfb2d2e09 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:38.748922 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-65228ebc-5eee-48cf-9150-faadfb2d2e09 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1515 microversion: 2.1 time: 0.186716 Nov 19 03:23:38.749548 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 293/612] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:38 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:38.802434 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b6d8b8b8-86b7-4c03-a040-3e1e8e9310b6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:38.809729 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b6d8b8b8-86b7-4c03-a040-3e1e8e9310b6 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.181350 Nov 19 03:23:38.810506 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 320/613] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:38 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:38.908329 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-bc3f746f-33c1-4cce-bbdd-5b6a8040ff4e req-9564faf3-e1b7-4050-8af8-0c2fdf82776e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8641ae42-77ad-4054-8073-76018892c1d8", "name": "network-vif-unplugged", "status": "completed", "tag": "4b50d896-6a79-4185-a31c-1931a0b889be"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:38.909910 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:23:38.909910 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:23:38.916691 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-bc3f746f-33c1-4cce-bbdd-5b6a8040ff4e req-9564faf3-e1b7-4050-8af8-0c2fdf82776e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:38.917136 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-bc3f746f-33c1-4cce-bbdd-5b6a8040ff4e req-9564faf3-e1b7-4050-8af8-0c2fdf82776e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:38.929121 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-bc3f746f-33c1-4cce-bbdd-5b6a8040ff4e req-9564faf3-e1b7-4050-8af8-0c2fdf82776e service nova] Creating event network-vif-unplugged:4b50d896-6a79-4185-a31c-1931a0b889be for instance 8641ae42-77ad-4054-8073-76018892c1d8 on hv-cinder-81803 Nov 19 03:23:38.934025 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-bc3f746f-33c1-4cce-bbdd-5b6a8040ff4e req-9564faf3-e1b7-4050-8af8-0c2fdf82776e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029963 Nov 19 03:23:38.934691 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 294/614] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:23:38 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:23:39.240959 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b0571e87-5719-4841-b4fe-ec53dbb0877f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:39.241558 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b0571e87-5719-4841-b4fe-ec53dbb0877f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:39.247782 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b0571e87-5719-4841-b4fe-ec53dbb0877f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.248366 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b0571e87-5719-4841-b4fe-ec53dbb0877f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:39.249004 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b0571e87-5719-4841-b4fe-ec53dbb0877f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.249424 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b0571e87-5719-4841-b4fe-ec53dbb0877f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:39.278225 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-624a0aa4-06ba-4e06-8e1f-88476650c00e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:39.279228 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-624a0aa4-06ba-4e06-8e1f-88476650c00e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:39.286860 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-624a0aa4-06ba-4e06-8e1f-88476650c00e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.287299 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-624a0aa4-06ba-4e06-8e1f-88476650c00e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:39.288072 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-624a0aa4-06ba-4e06-8e1f-88476650c00e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.288496 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-624a0aa4-06ba-4e06-8e1f-88476650c00e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:39.380994 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b0571e87-5719-4841-b4fe-ec53dbb0877f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:39.389690 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-624a0aa4-06ba-4e06-8e1f-88476650c00e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.115459 Nov 19 03:23:39.390197 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b0571e87-5719-4841-b4fe-ec53dbb0877f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:39.393570 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 295/615] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:39 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:23:39.393699 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b0571e87-5719-4841-b4fe-ec53dbb0877f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:39.393699 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b0571e87-5719-4841-b4fe-ec53dbb0877f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1662 microversion: 2.20 time: 0.155710 Nov 19 03:23:39.393699 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 321/616] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:39 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:39.411328 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b02a36c9-90e3-486b-bf7a-fb61abd5f140 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ba4acb0-8ae6-4900-b2ef-f13a5fbae966"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:39.412487 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b02a36c9-90e3-486b-bf7a-fb61abd5f140 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:39.419358 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b02a36c9-90e3-486b-bf7a-fb61abd5f140 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.419803 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b02a36c9-90e3-486b-bf7a-fb61abd5f140 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:39.420922 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b02a36c9-90e3-486b-bf7a-fb61abd5f140 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.421359 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b02a36c9-90e3-486b-bf7a-fb61abd5f140 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:39.685492 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b02a36c9-90e3-486b-bf7a-fb61abd5f140 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.278233 Nov 19 03:23:39.686670 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 296/617] 10.222.0.47 () {62 vars in 1363 bytes} [Fri Nov 19 03:23:39 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments => generated 188 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:23:39.765647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3a02e46e-0701-4f1b-8c70-030be5d59361 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:39.766253 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3a02e46e-0701-4f1b-8c70-030be5d59361 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:39.772902 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3a02e46e-0701-4f1b-8c70-030be5d59361 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.773345 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3a02e46e-0701-4f1b-8c70-030be5d59361 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:39.774166 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3a02e46e-0701-4f1b-8c70-030be5d59361 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.774620 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3a02e46e-0701-4f1b-8c70-030be5d59361 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:39.794643 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-212f4535-884d-4ec8-bb88-7cb79451871f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:39.795699 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-212f4535-884d-4ec8-bb88-7cb79451871f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:39.801535 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-212f4535-884d-4ec8-bb88-7cb79451871f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.801986 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-212f4535-884d-4ec8-bb88-7cb79451871f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:39.802796 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-212f4535-884d-4ec8-bb88-7cb79451871f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.803231 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-212f4535-884d-4ec8-bb88-7cb79451871f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:39.903773 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-212f4535-884d-4ec8-bb88-7cb79451871f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action" status: 202 len: 0 microversion: 2.20 time: 0.113092 Nov 19 03:23:39.905280 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 297/618] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:23:39 2021] POST /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 19 03:23:39.913275 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-bffa095b-46b0-4b60-9202-6d75da6ad520 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:39.913887 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-bffa095b-46b0-4b60-9202-6d75da6ad520 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:39.919784 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bffa095b-46b0-4b60-9202-6d75da6ad520 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.920578 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bffa095b-46b0-4b60-9202-6d75da6ad520 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:39.921401 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bffa095b-46b0-4b60-9202-6d75da6ad520 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.921841 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bffa095b-46b0-4b60-9202-6d75da6ad520 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:39.932929 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3a02e46e-0701-4f1b-8c70-030be5d59361 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:39.942685 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3a02e46e-0701-4f1b-8c70-030be5d59361 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1515 microversion: 2.1 time: 0.181287 Nov 19 03:23:39.943921 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 322/619] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:39 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:39.949722 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7f3eb00f-df90-4472-8482-6faf1ae93d98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:39.950498 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7f3eb00f-df90-4472-8482-6faf1ae93d98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:39.958515 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7f3eb00f-df90-4472-8482-6faf1ae93d98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.959046 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7f3eb00f-df90-4472-8482-6faf1ae93d98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:39.960038 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7f3eb00f-df90-4472-8482-6faf1ae93d98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:39.960687 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7f3eb00f-df90-4472-8482-6faf1ae93d98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:40.097211 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-bffa095b-46b0-4b60-9202-6d75da6ad520 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:40.105191 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-bffa095b-46b0-4b60-9202-6d75da6ad520 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.195962 Nov 19 03:23:40.105834 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 298/620] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:39 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:40.140559 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7f3eb00f-df90-4472-8482-6faf1ae93d98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:40.148700 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7f3eb00f-df90-4472-8482-6faf1ae93d98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:40.150156 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7f3eb00f-df90-4472-8482-6faf1ae93d98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:40.151345 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7f3eb00f-df90-4472-8482-6faf1ae93d98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1748 microversion: 2.20 time: 0.206195 Nov 19 03:23:40.152160 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 323/621] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:39 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1748 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:40.402184 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4565adc4-bb9b-469b-b8af-e2d3d8d1ed1e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:40.403244 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4565adc4-bb9b-469b-b8af-e2d3d8d1ed1e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:40.409885 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4565adc4-bb9b-469b-b8af-e2d3d8d1ed1e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:40.410334 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4565adc4-bb9b-469b-b8af-e2d3d8d1ed1e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:40.411141 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4565adc4-bb9b-469b-b8af-e2d3d8d1ed1e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:40.411740 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4565adc4-bb9b-469b-b8af-e2d3d8d1ed1e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:40.505974 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4565adc4-bb9b-469b-b8af-e2d3d8d1ed1e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.108300 Nov 19 03:23:40.506641 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 299/622] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:40 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:40.707263 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-b3efecd7-640d-4837-82cd-a5b3762fb1d8 req-07b4c7dc-9c70-49b4-837e-4c38c5a776de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bbce071-8bbc-400a-b7f8-5e42b947e146", "name": "network-vif-deleted", "tag": "ed5e2924-c9bb-46bb-87d4-7e2249b2a8b3"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:40.708957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:23:40.708957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:23:40.718274 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-b3efecd7-640d-4837-82cd-a5b3762fb1d8 req-07b4c7dc-9c70-49b4-837e-4c38c5a776de service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:40.718914 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-b3efecd7-640d-4837-82cd-a5b3762fb1d8 req-07b4c7dc-9c70-49b4-837e-4c38c5a776de service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:40.731858 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-b3efecd7-640d-4837-82cd-a5b3762fb1d8 req-07b4c7dc-9c70-49b4-837e-4c38c5a776de service nova] Creating event network-vif-deleted:ed5e2924-c9bb-46bb-87d4-7e2249b2a8b3 for instance 1bbce071-8bbc-400a-b7f8-5e42b947e146 on hv-cinder-81803 Nov 19 03:23:40.736974 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-b3efecd7-640d-4837-82cd-a5b3762fb1d8 req-07b4c7dc-9c70-49b4-837e-4c38c5a776de service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033232 Nov 19 03:23:40.741475 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 324/623] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:23:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:23:40.961009 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2dad3ce5-c8e2-49fc-adc8-154cac897d4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:40.961778 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2dad3ce5-c8e2-49fc-adc8-154cac897d4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:40.969419 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2dad3ce5-c8e2-49fc-adc8-154cac897d4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:40.969860 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2dad3ce5-c8e2-49fc-adc8-154cac897d4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:40.970669 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2dad3ce5-c8e2-49fc-adc8-154cac897d4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:40.971101 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2dad3ce5-c8e2-49fc-adc8-154cac897d4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:41.006199 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2dad3ce5-c8e2-49fc-adc8-154cac897d4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:41.006684 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2dad3ce5-c8e2-49fc-adc8-154cac897d4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:41.007157 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.objects.instance [None req-2dad3ce5-c8e2-49fc-adc8-154cac897d4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lazy-loading 'fault' on Instance uuid 1bbce071-8bbc-400a-b7f8-5e42b947e146 {{(pid=116066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:41.048838 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2dad3ce5-c8e2-49fc-adc8-154cac897d4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:41.056016 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2dad3ce5-c8e2-49fc-adc8-154cac897d4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 200 len: 1308 microversion: 2.1 time: 0.099096 Nov 19 03:23:41.056572 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 300/624] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:40 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:41.122425 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1c9e8157-7c7b-451f-bf97-c9d01b6b68ce tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:41.123165 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1c9e8157-7c7b-451f-bf97-c9d01b6b68ce tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:41.129462 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c9e8157-7c7b-451f-bf97-c9d01b6b68ce tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:41.129915 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c9e8157-7c7b-451f-bf97-c9d01b6b68ce tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:41.130723 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c9e8157-7c7b-451f-bf97-c9d01b6b68ce tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:41.131185 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c9e8157-7c7b-451f-bf97-c9d01b6b68ce tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:41.168914 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1244d331-3d61-4ba9-ac1c-ba6844f4e2b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:41.169654 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1244d331-3d61-4ba9-ac1c-ba6844f4e2b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:41.176973 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1244d331-3d61-4ba9-ac1c-ba6844f4e2b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:41.177523 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1244d331-3d61-4ba9-ac1c-ba6844f4e2b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:41.178310 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1244d331-3d61-4ba9-ac1c-ba6844f4e2b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:41.178771 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1244d331-3d61-4ba9-ac1c-ba6844f4e2b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:41.298707 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1c9e8157-7c7b-451f-bf97-c9d01b6b68ce tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:41.306355 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1c9e8157-7c7b-451f-bf97-c9d01b6b68ce tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.187886 Nov 19 03:23:41.306990 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 325/625] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:41 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:41.351790 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1244d331-3d61-4ba9-ac1c-ba6844f4e2b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:41.361282 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1244d331-3d61-4ba9-ac1c-ba6844f4e2b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:41.362786 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1244d331-3d61-4ba9-ac1c-ba6844f4e2b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:41.363980 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1244d331-3d61-4ba9-ac1c-ba6844f4e2b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1750 microversion: 2.20 time: 0.198770 Nov 19 03:23:41.364526 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 301/626] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:41 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1750 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:23:41.517786 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3f83391c-7197-4e9b-bf88-d5c829e51fbd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:41.518739 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3f83391c-7197-4e9b-bf88-d5c829e51fbd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:41.524843 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3f83391c-7197-4e9b-bf88-d5c829e51fbd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:41.525348 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3f83391c-7197-4e9b-bf88-d5c829e51fbd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:41.526163 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3f83391c-7197-4e9b-bf88-d5c829e51fbd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:41.526681 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3f83391c-7197-4e9b-bf88-d5c829e51fbd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:41.644713 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3f83391c-7197-4e9b-bf88-d5c829e51fbd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.131102 Nov 19 03:23:41.645364 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 326/627] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:41 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:42.072722 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7dd08dab-4fc4-454d-b440-800a362373ca tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:42.073257 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7dd08dab-4fc4-454d-b440-800a362373ca tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 1bbce071-8bbc-400a-b7f8-5e42b947e146] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:42.082131 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7dd08dab-4fc4-454d-b440-800a362373ca tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:42.082751 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7dd08dab-4fc4-454d-b440-800a362373ca tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:42.083531 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7dd08dab-4fc4-454d-b440-800a362373ca tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:42.083958 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7dd08dab-4fc4-454d-b440-800a362373ca tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:42.098665 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-7dd08dab-4fc4-454d-b440-800a362373ca tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] HTTP exception thrown: Instance 1bbce071-8bbc-400a-b7f8-5e42b947e146 could not be found. Nov 19 03:23:42.099255 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7dd08dab-4fc4-454d-b440-800a362373ca tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Returning 404 to user: Instance 1bbce071-8bbc-400a-b7f8-5e42b947e146 could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:23:42.100077 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7dd08dab-4fc4-454d-b440-800a362373ca tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146" status: 404 len: 111 microversion: 2.1 time: 0.031057 Nov 19 03:23:42.100619 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 302/628] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:42 2021] GET /compute/v2.1/servers/1bbce071-8bbc-400a-b7f8-5e42b947e146 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:23:42.109199 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0d5cd1a7-2bca-440b-9525-b63eff786dc8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:42.109781 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0d5cd1a7-2bca-440b-9525-b63eff786dc8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:42.116622 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d5cd1a7-2bca-440b-9525-b63eff786dc8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:42.117072 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d5cd1a7-2bca-440b-9525-b63eff786dc8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:42.117849 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d5cd1a7-2bca-440b-9525-b63eff786dc8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:42.118285 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d5cd1a7-2bca-440b-9525-b63eff786dc8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:42.144858 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0d5cd1a7-2bca-440b-9525-b63eff786dc8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Going to try to terminate instance {{(pid=116065) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:23:42.220767 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0d5cd1a7-2bca-440b-9525-b63eff786dc8 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "DELETE /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 204 len: 0 microversion: 2.1 time: 0.115487 Nov 19 03:23:42.221492 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 327/629] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:23:42 2021] DELETE /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:23:42.229585 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8fe2023a-9278-457d-bf34-073c783f28ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:42.230187 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8fe2023a-9278-457d-bf34-073c783f28ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:42.236339 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8fe2023a-9278-457d-bf34-073c783f28ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:42.236785 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8fe2023a-9278-457d-bf34-073c783f28ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:42.237570 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8fe2023a-9278-457d-bf34-073c783f28ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:42.238003 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8fe2023a-9278-457d-bf34-073c783f28ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:42.325419 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-85579e3f-f4e3-4f82-813f-6e23854a49a5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:42.326185 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-85579e3f-f4e3-4f82-813f-6e23854a49a5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:42.333664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-85579e3f-f4e3-4f82-813f-6e23854a49a5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:42.334114 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-85579e3f-f4e3-4f82-813f-6e23854a49a5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:42.334927 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-85579e3f-f4e3-4f82-813f-6e23854a49a5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:42.335359 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-85579e3f-f4e3-4f82-813f-6e23854a49a5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:42.388418 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8fe2023a-9278-457d-bf34-073c783f28ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:42.396922 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8fe2023a-9278-457d-bf34-073c783f28ab tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.171051 Nov 19 03:23:42.397640 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 303/630] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:42 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:42.403023 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-97313159-2646-40f8-8267-e91ec9199515 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:42.403776 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-97313159-2646-40f8-8267-e91ec9199515 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:42.410767 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-97313159-2646-40f8-8267-e91ec9199515 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:42.411265 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-97313159-2646-40f8-8267-e91ec9199515 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:42.412096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-97313159-2646-40f8-8267-e91ec9199515 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:42.412554 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-97313159-2646-40f8-8267-e91ec9199515 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:42.518447 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-85579e3f-f4e3-4f82-813f-6e23854a49a5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:42.525866 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-85579e3f-f4e3-4f82-813f-6e23854a49a5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1523 microversion: 2.1 time: 0.204470 Nov 19 03:23:42.526553 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 328/631] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:42 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:42.582846 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-97313159-2646-40f8-8267-e91ec9199515 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:42.591625 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-97313159-2646-40f8-8267-e91ec9199515 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:42.593957 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-97313159-2646-40f8-8267-e91ec9199515 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:42.595169 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-97313159-2646-40f8-8267-e91ec9199515 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.195859 Nov 19 03:23:42.595724 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 304/632] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:42 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:42.656908 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0431047d-2ccc-4b5c-9dfc-fafc0fe14acd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:42.657829 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0431047d-2ccc-4b5c-9dfc-fafc0fe14acd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:42.663646 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0431047d-2ccc-4b5c-9dfc-fafc0fe14acd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:42.664098 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0431047d-2ccc-4b5c-9dfc-fafc0fe14acd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:42.664882 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0431047d-2ccc-4b5c-9dfc-fafc0fe14acd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:42.665314 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0431047d-2ccc-4b5c-9dfc-fafc0fe14acd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:42.827166 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0431047d-2ccc-4b5c-9dfc-fafc0fe14acd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.173480 Nov 19 03:23:42.832705 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 329/633] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:42 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:23:43.414967 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-dd8e583f-a20d-43b8-8f70-48c2c95718a6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:43.415544 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-dd8e583f-a20d-43b8-8f70-48c2c95718a6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:43.421849 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dd8e583f-a20d-43b8-8f70-48c2c95718a6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:43.422298 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dd8e583f-a20d-43b8-8f70-48c2c95718a6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:43.423121 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dd8e583f-a20d-43b8-8f70-48c2c95718a6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:43.423536 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dd8e583f-a20d-43b8-8f70-48c2c95718a6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:43.544220 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c99ef83c-0443-4992-be25-476a810b9ff5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:43.545116 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c99ef83c-0443-4992-be25-476a810b9ff5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:43.554021 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c99ef83c-0443-4992-be25-476a810b9ff5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:43.554855 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c99ef83c-0443-4992-be25-476a810b9ff5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:43.555912 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c99ef83c-0443-4992-be25-476a810b9ff5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:43.556573 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c99ef83c-0443-4992-be25-476a810b9ff5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:43.684584 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c99ef83c-0443-4992-be25-476a810b9ff5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:43.692835 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c99ef83c-0443-4992-be25-476a810b9ff5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1481 microversion: 2.1 time: 0.152522 Nov 19 03:23:43.693564 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 330/634] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:43 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1481 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:43.703485 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-dd8e583f-a20d-43b8-8f70-48c2c95718a6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:43.708043 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3c7a351a-79bb-419a-b9fa-b68351310186 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:43.708662 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3c7a351a-79bb-419a-b9fa-b68351310186 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:43.712708 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-dd8e583f-a20d-43b8-8f70-48c2c95718a6 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.301347 Nov 19 03:23:43.713592 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 305/635] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:43 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:43.715625 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3c7a351a-79bb-419a-b9fa-b68351310186 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:43.716082 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3c7a351a-79bb-419a-b9fa-b68351310186 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:43.716885 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3c7a351a-79bb-419a-b9fa-b68351310186 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:43.718725 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3c7a351a-79bb-419a-b9fa-b68351310186 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:43.740272 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-17d4e315-bf80-4af5-81d6-0f28494857fe req-2c65c2c4-1788-4527-9066-d73bc82082ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19ae39a-79ce-4adb-9ee4-595daa1a8d27", "name": "network-vif-deleted", "tag": "f3a1472b-becd-4a09-9300-3ef891038626"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:43.741997 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:23:43.741997 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:23:43.749688 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-17d4e315-bf80-4af5-81d6-0f28494857fe req-2c65c2c4-1788-4527-9066-d73bc82082ab service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:43.750211 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-17d4e315-bf80-4af5-81d6-0f28494857fe req-2c65c2c4-1788-4527-9066-d73bc82082ab service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:43.761857 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-17d4e315-bf80-4af5-81d6-0f28494857fe req-2c65c2c4-1788-4527-9066-d73bc82082ab service nova] Creating event network-vif-deleted:f3a1472b-becd-4a09-9300-3ef891038626 for instance b19ae39a-79ce-4adb-9ee4-595daa1a8d27 on hv-cinder-81803 Nov 19 03:23:43.768066 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-17d4e315-bf80-4af5-81d6-0f28494857fe req-2c65c2c4-1788-4527-9066-d73bc82082ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031057 Nov 19 03:23:43.769271 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 306/636] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:23:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:23:43.840433 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d1750d95-49fb-467a-bba4-e7cdd53552d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:43.850122 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d1750d95-49fb-467a-bba4-e7cdd53552d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:43.862383 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d1750d95-49fb-467a-bba4-e7cdd53552d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:43.862898 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d1750d95-49fb-467a-bba4-e7cdd53552d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:43.863738 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d1750d95-49fb-467a-bba4-e7cdd53552d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:43.864203 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d1750d95-49fb-467a-bba4-e7cdd53552d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:43.904422 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3c7a351a-79bb-419a-b9fa-b68351310186 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:43.918459 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3c7a351a-79bb-419a-b9fa-b68351310186 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:43.920941 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3c7a351a-79bb-419a-b9fa-b68351310186 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:43.922531 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3c7a351a-79bb-419a-b9fa-b68351310186 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.218243 Nov 19 03:23:43.923255 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 331/637] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:43 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:43.993870 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d1750d95-49fb-467a-bba4-e7cdd53552d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 28646 microversion: 2.1 time: 0.157212 Nov 19 03:23:43.994647 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 307/638] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:43 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 28646 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:23:44.713439 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e1420a43-b14e-4612-a907-b7a1c3c7c5d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:44.714597 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e1420a43-b14e-4612-a907-b7a1c3c7c5d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:44.735247 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e1420a43-b14e-4612-a907-b7a1c3c7c5d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:44.735695 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e1420a43-b14e-4612-a907-b7a1c3c7c5d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:44.736487 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e1420a43-b14e-4612-a907-b7a1c3c7c5d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:44.736922 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e1420a43-b14e-4612-a907-b7a1c3c7c5d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:44.740684 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-41b5c65a-5ad1-4ffc-87e6-b232f3d69d14 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:44.742180 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-41b5c65a-5ad1-4ffc-87e6-b232f3d69d14 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:44.755237 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-41b5c65a-5ad1-4ffc-87e6-b232f3d69d14 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:44.756515 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-41b5c65a-5ad1-4ffc-87e6-b232f3d69d14 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:44.758281 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-41b5c65a-5ad1-4ffc-87e6-b232f3d69d14 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:44.759446 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-41b5c65a-5ad1-4ffc-87e6-b232f3d69d14 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:44.794711 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e1420a43-b14e-4612-a907-b7a1c3c7c5d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:44.795748 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e1420a43-b14e-4612-a907-b7a1c3c7c5d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:44.796304 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-e1420a43-b14e-4612-a907-b7a1c3c7c5d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:44.863809 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e1420a43-b14e-4612-a907-b7a1c3c7c5d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:44.871139 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e1420a43-b14e-4612-a907-b7a1c3c7c5d4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.163970 Nov 19 03:23:44.871710 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 332/639] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:44 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:44.941509 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-41b5c65a-5ad1-4ffc-87e6-b232f3d69d14 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:44.946900 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-13762e79-af99-4d0e-a69f-9d7523cc90e5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:44.947880 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-13762e79-af99-4d0e-a69f-9d7523cc90e5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:44.957940 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-41b5c65a-5ad1-4ffc-87e6-b232f3d69d14 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.219785 Nov 19 03:23:44.958956 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 308/640] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:44 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:44.962897 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-13762e79-af99-4d0e-a69f-9d7523cc90e5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:44.963405 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-13762e79-af99-4d0e-a69f-9d7523cc90e5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:44.964291 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-13762e79-af99-4d0e-a69f-9d7523cc90e5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:44.964675 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-13762e79-af99-4d0e-a69f-9d7523cc90e5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:45.006749 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-af447772-638d-49a3-b999-02cb04290aa8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:45.007980 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-af447772-638d-49a3-b999-02cb04290aa8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:45.015237 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af447772-638d-49a3-b999-02cb04290aa8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:45.015677 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af447772-638d-49a3-b999-02cb04290aa8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:45.016490 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af447772-638d-49a3-b999-02cb04290aa8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:45.016926 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af447772-638d-49a3-b999-02cb04290aa8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:45.138090 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-13762e79-af99-4d0e-a69f-9d7523cc90e5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:45.150415 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-13762e79-af99-4d0e-a69f-9d7523cc90e5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:45.152163 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-13762e79-af99-4d0e-a69f-9d7523cc90e5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:45.153317 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-13762e79-af99-4d0e-a69f-9d7523cc90e5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.210614 Nov 19 03:23:45.153877 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 333/641] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:44 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:45.888172 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-89483bce-40dc-48b5-a273-a4fc338af00e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:45.890318 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-89483bce-40dc-48b5-a273-a4fc338af00e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:45.906728 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89483bce-40dc-48b5-a273-a4fc338af00e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:45.907195 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89483bce-40dc-48b5-a273-a4fc338af00e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:45.907990 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89483bce-40dc-48b5-a273-a4fc338af00e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:45.908424 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89483bce-40dc-48b5-a273-a4fc338af00e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:45.951014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89483bce-40dc-48b5-a273-a4fc338af00e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:45.951500 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89483bce-40dc-48b5-a273-a4fc338af00e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:45.951943 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-89483bce-40dc-48b5-a273-a4fc338af00e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:45.992785 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-89483bce-40dc-48b5-a273-a4fc338af00e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:46.000867 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-89483bce-40dc-48b5-a273-a4fc338af00e tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.116434 Nov 19 03:23:46.001444 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 334/642] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:45 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:46.005638 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ccac4a74-7f40-43eb-b885-b5c1ef32789d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:46.006239 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ccac4a74-7f40-43eb-b885-b5c1ef32789d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:46.013444 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ccac4a74-7f40-43eb-b885-b5c1ef32789d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:46.013924 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ccac4a74-7f40-43eb-b885-b5c1ef32789d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:46.014733 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ccac4a74-7f40-43eb-b885-b5c1ef32789d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:46.015163 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ccac4a74-7f40-43eb-b885-b5c1ef32789d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:46.157789 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ccac4a74-7f40-43eb-b885-b5c1ef32789d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:46.165919 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ccac4a74-7f40-43eb-b885-b5c1ef32789d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.163438 Nov 19 03:23:46.174262 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 335/643] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:46 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:46.177961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-86879fab-be36-4587-972c-22244dfee372 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:46.178602 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-86879fab-be36-4587-972c-22244dfee372 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:46.184735 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-86879fab-be36-4587-972c-22244dfee372 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:46.185189 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-86879fab-be36-4587-972c-22244dfee372 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:46.186345 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-86879fab-be36-4587-972c-22244dfee372 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:46.186838 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-86879fab-be36-4587-972c-22244dfee372 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:46.322943 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-86879fab-be36-4587-972c-22244dfee372 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:46.332463 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-86879fab-be36-4587-972c-22244dfee372 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:46.333994 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-86879fab-be36-4587-972c-22244dfee372 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:46.335267 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-86879fab-be36-4587-972c-22244dfee372 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.167330 Nov 19 03:23:46.335915 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 336/644] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:46 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:47.017658 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-cef6d50e-cd48-4b97-bdad-d68d409de452 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:47.018395 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-cef6d50e-cd48-4b97-bdad-d68d409de452 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:47.025659 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cef6d50e-cd48-4b97-bdad-d68d409de452 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:47.026101 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cef6d50e-cd48-4b97-bdad-d68d409de452 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:47.027251 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cef6d50e-cd48-4b97-bdad-d68d409de452 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:47.027683 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cef6d50e-cd48-4b97-bdad-d68d409de452 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:47.058821 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cef6d50e-cd48-4b97-bdad-d68d409de452 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:47.059278 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cef6d50e-cd48-4b97-bdad-d68d409de452 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:47.059733 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-cef6d50e-cd48-4b97-bdad-d68d409de452 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:47.100705 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-cef6d50e-cd48-4b97-bdad-d68d409de452 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:47.108736 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-cef6d50e-cd48-4b97-bdad-d68d409de452 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.095101 Nov 19 03:23:47.109301 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 337/645] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:47 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:47.185837 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6bda0b04-4b9a-41ce-84c4-2b0a9099e5c4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:47.186865 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6bda0b04-4b9a-41ce-84c4-2b0a9099e5c4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:47.193907 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6bda0b04-4b9a-41ce-84c4-2b0a9099e5c4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:47.194650 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6bda0b04-4b9a-41ce-84c4-2b0a9099e5c4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:47.195644 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6bda0b04-4b9a-41ce-84c4-2b0a9099e5c4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:47.196348 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6bda0b04-4b9a-41ce-84c4-2b0a9099e5c4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:47.343859 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6bda0b04-4b9a-41ce-84c4-2b0a9099e5c4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:47.351455 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6bda0b04-4b9a-41ce-84c4-2b0a9099e5c4 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.171426 Nov 19 03:23:47.352032 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 338/646] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:47 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:47.356813 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f4a69b1d-c910-4660-99cd-591116c14541 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:47.357469 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f4a69b1d-c910-4660-99cd-591116c14541 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:47.364847 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4a69b1d-c910-4660-99cd-591116c14541 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:47.365379 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4a69b1d-c910-4660-99cd-591116c14541 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:47.366243 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4a69b1d-c910-4660-99cd-591116c14541 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:47.366796 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4a69b1d-c910-4660-99cd-591116c14541 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:47.510745 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f4a69b1d-c910-4660-99cd-591116c14541 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:47.520477 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f4a69b1d-c910-4660-99cd-591116c14541 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:47.521982 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f4a69b1d-c910-4660-99cd-591116c14541 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:47.523168 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f4a69b1d-c910-4660-99cd-591116c14541 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.170208 Nov 19 03:23:47.523722 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 339/647] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:47 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:48.125814 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ec60f844-b367-44c7-afd5-79022c7baaf5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:48.126595 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ec60f844-b367-44c7-afd5-79022c7baaf5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:48.132637 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ec60f844-b367-44c7-afd5-79022c7baaf5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:48.133086 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ec60f844-b367-44c7-afd5-79022c7baaf5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:48.133882 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ec60f844-b367-44c7-afd5-79022c7baaf5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:48.134448 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ec60f844-b367-44c7-afd5-79022c7baaf5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:48.168039 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ec60f844-b367-44c7-afd5-79022c7baaf5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:48.168488 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ec60f844-b367-44c7-afd5-79022c7baaf5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:48.168933 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-ec60f844-b367-44c7-afd5-79022c7baaf5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:48.208103 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ec60f844-b367-44c7-afd5-79022c7baaf5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:48.215354 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ec60f844-b367-44c7-afd5-79022c7baaf5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.093823 Nov 19 03:23:48.215948 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 340/648] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:48 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:48.369006 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-eefba378-0250-4ef6-a185-6aa083c62872 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:48.369715 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-eefba378-0250-4ef6-a185-6aa083c62872 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:48.376415 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eefba378-0250-4ef6-a185-6aa083c62872 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:48.377023 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eefba378-0250-4ef6-a185-6aa083c62872 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:48.378189 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eefba378-0250-4ef6-a185-6aa083c62872 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:48.378775 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eefba378-0250-4ef6-a185-6aa083c62872 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:48.527325 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-eefba378-0250-4ef6-a185-6aa083c62872 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:48.535024 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-eefba378-0250-4ef6-a185-6aa083c62872 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.169894 Nov 19 03:23:48.535594 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 341/649] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:48 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:48.542886 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-253c456b-547b-46bb-91b1-0d331fbf97e3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:48.543511 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-253c456b-547b-46bb-91b1-0d331fbf97e3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:48.553870 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-253c456b-547b-46bb-91b1-0d331fbf97e3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:48.554317 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-253c456b-547b-46bb-91b1-0d331fbf97e3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:48.555135 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-253c456b-547b-46bb-91b1-0d331fbf97e3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:48.555568 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-253c456b-547b-46bb-91b1-0d331fbf97e3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:48.705507 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-253c456b-547b-46bb-91b1-0d331fbf97e3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:48.713964 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-253c456b-547b-46bb-91b1-0d331fbf97e3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:48.715638 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-253c456b-547b-46bb-91b1-0d331fbf97e3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:48.716588 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-253c456b-547b-46bb-91b1-0d331fbf97e3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.177095 Nov 19 03:23:48.717433 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 342/650] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:48 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:23:48.950825 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-398cc48a-f645-4ebe-9746-af9379b8d1d3 req-63ec70cc-b035-4594-a224-2fbef184f9cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824fcf10-8c9b-461d-8206-1c9ae5d4011b", "name": "network-vif-unplugged", "status": "completed", "tag": "004bc3b2-8042-48ab-abde-62fc17b827d2"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:23:48.952581 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:23:48.952581 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:23:48.960012 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-398cc48a-f645-4ebe-9746-af9379b8d1d3 req-63ec70cc-b035-4594-a224-2fbef184f9cc service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:48.960506 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-398cc48a-f645-4ebe-9746-af9379b8d1d3 req-63ec70cc-b035-4594-a224-2fbef184f9cc service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:48.972658 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-398cc48a-f645-4ebe-9746-af9379b8d1d3 req-63ec70cc-b035-4594-a224-2fbef184f9cc service nova] Creating event network-vif-unplugged:004bc3b2-8042-48ab-abde-62fc17b827d2 for instance 824fcf10-8c9b-461d-8206-1c9ae5d4011b on hv-cinder-81803 Nov 19 03:23:48.977592 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-398cc48a-f645-4ebe-9746-af9379b8d1d3 req-63ec70cc-b035-4594-a224-2fbef184f9cc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030473 Nov 19 03:23:48.978193 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 343/651] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:23:48 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:23:49.234208 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-08e8d93a-8a02-4504-b806-3cd69f02544b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:49.235022 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-08e8d93a-8a02-4504-b806-3cd69f02544b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:49.241411 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-08e8d93a-8a02-4504-b806-3cd69f02544b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:49.241902 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-08e8d93a-8a02-4504-b806-3cd69f02544b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:49.242756 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-08e8d93a-8a02-4504-b806-3cd69f02544b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:49.243204 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-08e8d93a-8a02-4504-b806-3cd69f02544b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:49.276112 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-08e8d93a-8a02-4504-b806-3cd69f02544b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:49.276607 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-08e8d93a-8a02-4504-b806-3cd69f02544b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:49.277348 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-08e8d93a-8a02-4504-b806-3cd69f02544b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:49.321662 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-08e8d93a-8a02-4504-b806-3cd69f02544b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:49.331628 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-08e8d93a-8a02-4504-b806-3cd69f02544b tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.102054 Nov 19 03:23:49.341840 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 344/652] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:49 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:49.552238 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-74e1fcee-43db-478e-b67b-5440eb243742 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:49.552685 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-74e1fcee-43db-478e-b67b-5440eb243742 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:49.558570 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-74e1fcee-43db-478e-b67b-5440eb243742 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:49.559006 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-74e1fcee-43db-478e-b67b-5440eb243742 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:49.559777 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-74e1fcee-43db-478e-b67b-5440eb243742 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:49.560216 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-74e1fcee-43db-478e-b67b-5440eb243742 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:49.697376 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-74e1fcee-43db-478e-b67b-5440eb243742 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:49.705780 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-74e1fcee-43db-478e-b67b-5440eb243742 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.157274 Nov 19 03:23:49.706369 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 345/653] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:49 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:49.734859 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6fbe54e1-8630-4562-8323-644161364e9c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:49.735560 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6fbe54e1-8630-4562-8323-644161364e9c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:49.741517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6fbe54e1-8630-4562-8323-644161364e9c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:49.741967 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6fbe54e1-8630-4562-8323-644161364e9c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:49.742773 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6fbe54e1-8630-4562-8323-644161364e9c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:49.743273 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6fbe54e1-8630-4562-8323-644161364e9c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:49.892683 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6fbe54e1-8630-4562-8323-644161364e9c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:49.900980 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6fbe54e1-8630-4562-8323-644161364e9c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:49.902747 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6fbe54e1-8630-4562-8323-644161364e9c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:49.903881 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6fbe54e1-8630-4562-8323-644161364e9c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.172665 Nov 19 03:23:49.905014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 346/654] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:49 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:23:50.349635 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a025d263-5cb1-4c0f-9867-1e7f59fd960a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:50.350377 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a025d263-5cb1-4c0f-9867-1e7f59fd960a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:50.356801 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a025d263-5cb1-4c0f-9867-1e7f59fd960a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:50.357249 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a025d263-5cb1-4c0f-9867-1e7f59fd960a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:50.358665 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a025d263-5cb1-4c0f-9867-1e7f59fd960a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:50.359096 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a025d263-5cb1-4c0f-9867-1e7f59fd960a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:50.390574 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a025d263-5cb1-4c0f-9867-1e7f59fd960a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:50.391025 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a025d263-5cb1-4c0f-9867-1e7f59fd960a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:50.391474 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-a025d263-5cb1-4c0f-9867-1e7f59fd960a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:50.450049 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a025d263-5cb1-4c0f-9867-1e7f59fd960a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:50.458461 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a025d263-5cb1-4c0f-9867-1e7f59fd960a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.112803 Nov 19 03:23:50.460333 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 347/655] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:50 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:50.724031 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-24c535f4-e019-42e6-8091-43404697fd5a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:50.724658 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-24c535f4-e019-42e6-8091-43404697fd5a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:50.730873 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-24c535f4-e019-42e6-8091-43404697fd5a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:50.731326 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-24c535f4-e019-42e6-8091-43404697fd5a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:50.732098 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-24c535f4-e019-42e6-8091-43404697fd5a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:50.733177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-24c535f4-e019-42e6-8091-43404697fd5a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:50.868943 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-24c535f4-e019-42e6-8091-43404697fd5a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:50.876343 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-24c535f4-e019-42e6-8091-43404697fd5a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.156443 Nov 19 03:23:50.876909 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 348/656] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:50 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:50.922791 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0a140f50-0911-4cab-9451-fe395bad5f29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:50.924384 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0a140f50-0911-4cab-9451-fe395bad5f29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:50.930709 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a140f50-0911-4cab-9451-fe395bad5f29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:50.930915 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a140f50-0911-4cab-9451-fe395bad5f29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:50.931709 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a140f50-0911-4cab-9451-fe395bad5f29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:50.932176 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a140f50-0911-4cab-9451-fe395bad5f29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:51.078822 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0a140f50-0911-4cab-9451-fe395bad5f29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:51.087792 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0a140f50-0911-4cab-9451-fe395bad5f29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:51.089279 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0a140f50-0911-4cab-9451-fe395bad5f29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:51.090434 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0a140f50-0911-4cab-9451-fe395bad5f29 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.172409 Nov 19 03:23:51.091026 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 349/657] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:50 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:23:51.475414 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ccd0f2f8-2a86-47c3-9ca3-3741e2fce23a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:51.476163 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ccd0f2f8-2a86-47c3-9ca3-3741e2fce23a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:51.482692 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ccd0f2f8-2a86-47c3-9ca3-3741e2fce23a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:51.483497 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ccd0f2f8-2a86-47c3-9ca3-3741e2fce23a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:51.484305 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ccd0f2f8-2a86-47c3-9ca3-3741e2fce23a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:51.484826 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ccd0f2f8-2a86-47c3-9ca3-3741e2fce23a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:51.516799 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ccd0f2f8-2a86-47c3-9ca3-3741e2fce23a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:51.517271 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ccd0f2f8-2a86-47c3-9ca3-3741e2fce23a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:51.517720 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-ccd0f2f8-2a86-47c3-9ca3-3741e2fce23a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:51.555505 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ccd0f2f8-2a86-47c3-9ca3-3741e2fce23a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:51.563867 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ccd0f2f8-2a86-47c3-9ca3-3741e2fce23a tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.092269 Nov 19 03:23:51.564447 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 350/658] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:51 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:51.893246 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d610daa7-5090-4902-82a8-498d4e3df68c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:51.893855 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d610daa7-5090-4902-82a8-498d4e3df68c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:51.901070 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d610daa7-5090-4902-82a8-498d4e3df68c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:51.901606 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d610daa7-5090-4902-82a8-498d4e3df68c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:51.902948 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d610daa7-5090-4902-82a8-498d4e3df68c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:51.903528 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d610daa7-5090-4902-82a8-498d4e3df68c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:52.063417 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d610daa7-5090-4902-82a8-498d4e3df68c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:52.071034 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d610daa7-5090-4902-82a8-498d4e3df68c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.181511 Nov 19 03:23:52.078571 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 351/659] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:51 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:52.108976 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b55c0274-2d28-4880-8223-15dee8128a02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:52.109588 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b55c0274-2d28-4880-8223-15dee8128a02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:52.115806 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b55c0274-2d28-4880-8223-15dee8128a02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:52.116409 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b55c0274-2d28-4880-8223-15dee8128a02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:52.117218 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b55c0274-2d28-4880-8223-15dee8128a02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:52.117649 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b55c0274-2d28-4880-8223-15dee8128a02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:52.253843 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b55c0274-2d28-4880-8223-15dee8128a02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:52.261901 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b55c0274-2d28-4880-8223-15dee8128a02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:52.263406 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b55c0274-2d28-4880-8223-15dee8128a02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:52.264662 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b55c0274-2d28-4880-8223-15dee8128a02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.159875 Nov 19 03:23:52.265219 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 352/660] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:52 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:23:52.580860 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-373691f0-64f2-4c93-876d-980b587cb2b5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:52.581664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-373691f0-64f2-4c93-876d-980b587cb2b5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:52.598128 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-373691f0-64f2-4c93-876d-980b587cb2b5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:52.598742 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-373691f0-64f2-4c93-876d-980b587cb2b5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:52.599544 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-373691f0-64f2-4c93-876d-980b587cb2b5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:52.599986 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-373691f0-64f2-4c93-876d-980b587cb2b5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:52.632539 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-373691f0-64f2-4c93-876d-980b587cb2b5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:52.632987 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-373691f0-64f2-4c93-876d-980b587cb2b5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:52.633440 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-373691f0-64f2-4c93-876d-980b587cb2b5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:52.677029 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-373691f0-64f2-4c93-876d-980b587cb2b5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:52.684970 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-373691f0-64f2-4c93-876d-980b587cb2b5 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.107739 Nov 19 03:23:52.686606 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 353/661] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:52 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:53.089651 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9f5837e1-e201-4787-b578-13ab3930716a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:53.089651 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9f5837e1-e201-4787-b578-13ab3930716a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:53.098795 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9f5837e1-e201-4787-b578-13ab3930716a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:53.099706 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9f5837e1-e201-4787-b578-13ab3930716a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:53.101225 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9f5837e1-e201-4787-b578-13ab3930716a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:53.101889 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9f5837e1-e201-4787-b578-13ab3930716a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:53.265380 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9f5837e1-e201-4787-b578-13ab3930716a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:53.275624 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9f5837e1-e201-4787-b578-13ab3930716a tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.190940 Nov 19 03:23:53.276194 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 354/662] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:53 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:53.282913 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-50749032-db63-4fae-a948-505f328f5d81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:53.283575 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-50749032-db63-4fae-a948-505f328f5d81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:53.289209 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-50749032-db63-4fae-a948-505f328f5d81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:53.289637 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-50749032-db63-4fae-a948-505f328f5d81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:53.290395 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-50749032-db63-4fae-a948-505f328f5d81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:53.290846 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-50749032-db63-4fae-a948-505f328f5d81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:53.429708 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-50749032-db63-4fae-a948-505f328f5d81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:53.438497 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-50749032-db63-4fae-a948-505f328f5d81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:53.439953 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-50749032-db63-4fae-a948-505f328f5d81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:53.441081 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-50749032-db63-4fae-a948-505f328f5d81 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.162103 Nov 19 03:23:53.441632 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 355/663] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:53 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:23:53.701499 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1c683ca2-a048-4b5c-979a-a98018cf1e50 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:53.702514 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1c683ca2-a048-4b5c-979a-a98018cf1e50 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:53.708432 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c683ca2-a048-4b5c-979a-a98018cf1e50 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:53.708869 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c683ca2-a048-4b5c-979a-a98018cf1e50 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:53.709631 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c683ca2-a048-4b5c-979a-a98018cf1e50 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:53.710056 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c683ca2-a048-4b5c-979a-a98018cf1e50 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:53.741092 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c683ca2-a048-4b5c-979a-a98018cf1e50 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:53.741531 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c683ca2-a048-4b5c-979a-a98018cf1e50 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:53.741972 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-1c683ca2-a048-4b5c-979a-a98018cf1e50 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:53.781755 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1c683ca2-a048-4b5c-979a-a98018cf1e50 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:53.789627 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1c683ca2-a048-4b5c-979a-a98018cf1e50 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.091749 Nov 19 03:23:53.790308 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 356/664] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:53 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:54.293166 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8f886b66-5008-496e-aaf6-581de13d57cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:54.293779 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8f886b66-5008-496e-aaf6-581de13d57cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:54.300489 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f886b66-5008-496e-aaf6-581de13d57cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:54.300937 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f886b66-5008-496e-aaf6-581de13d57cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:54.301710 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f886b66-5008-496e-aaf6-581de13d57cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:54.302144 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f886b66-5008-496e-aaf6-581de13d57cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:54.447889 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8f886b66-5008-496e-aaf6-581de13d57cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:54.455914 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8f886b66-5008-496e-aaf6-581de13d57cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.166290 Nov 19 03:23:54.456488 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 357/665] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:54 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:54.460775 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-89c0b6e4-ee0b-494a-8b37-a164e42c3fef tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:54.461428 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-89c0b6e4-ee0b-494a-8b37-a164e42c3fef tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:54.471013 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89c0b6e4-ee0b-494a-8b37-a164e42c3fef tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:54.471463 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89c0b6e4-ee0b-494a-8b37-a164e42c3fef tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:54.472269 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89c0b6e4-ee0b-494a-8b37-a164e42c3fef tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:54.472693 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89c0b6e4-ee0b-494a-8b37-a164e42c3fef tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:54.608219 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-89c0b6e4-ee0b-494a-8b37-a164e42c3fef tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:54.617460 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-89c0b6e4-ee0b-494a-8b37-a164e42c3fef tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:54.618979 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-89c0b6e4-ee0b-494a-8b37-a164e42c3fef tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:54.620153 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-89c0b6e4-ee0b-494a-8b37-a164e42c3fef tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.162762 Nov 19 03:23:54.620890 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 358/666] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:54 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:54.806271 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d5cbde62-65dc-4e6c-a9c3-244d768c9a7d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:54.807015 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d5cbde62-65dc-4e6c-a9c3-244d768c9a7d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:54.813466 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d5cbde62-65dc-4e6c-a9c3-244d768c9a7d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:54.813923 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d5cbde62-65dc-4e6c-a9c3-244d768c9a7d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:54.814768 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d5cbde62-65dc-4e6c-a9c3-244d768c9a7d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:54.815235 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d5cbde62-65dc-4e6c-a9c3-244d768c9a7d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:54.847568 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d5cbde62-65dc-4e6c-a9c3-244d768c9a7d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:54.848017 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d5cbde62-65dc-4e6c-a9c3-244d768c9a7d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:54.848486 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-d5cbde62-65dc-4e6c-a9c3-244d768c9a7d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:54.886534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d5cbde62-65dc-4e6c-a9c3-244d768c9a7d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:54.894708 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d5cbde62-65dc-4e6c-a9c3-244d768c9a7d tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.092026 Nov 19 03:23:54.895315 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 359/667] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:54 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:55.473171 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-49b103c4-5221-40db-97e9-5206af9b125c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:55.474032 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-49b103c4-5221-40db-97e9-5206af9b125c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:55.480069 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-49b103c4-5221-40db-97e9-5206af9b125c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:55.480518 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-49b103c4-5221-40db-97e9-5206af9b125c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:55.481303 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-49b103c4-5221-40db-97e9-5206af9b125c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:55.481739 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-49b103c4-5221-40db-97e9-5206af9b125c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:55.628930 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-49b103c4-5221-40db-97e9-5206af9b125c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:55.639696 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-49b103c4-5221-40db-97e9-5206af9b125c tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.167597 Nov 19 03:23:55.639696 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 360/668] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:55 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:55.653935 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8d39d69a-8696-4791-ad40-1636e0f1a954 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:55.654680 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8d39d69a-8696-4791-ad40-1636e0f1a954 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:55.672706 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8d39d69a-8696-4791-ad40-1636e0f1a954 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:55.673298 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8d39d69a-8696-4791-ad40-1636e0f1a954 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:55.674207 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8d39d69a-8696-4791-ad40-1636e0f1a954 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:55.674745 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8d39d69a-8696-4791-ad40-1636e0f1a954 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:55.811998 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8d39d69a-8696-4791-ad40-1636e0f1a954 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:55.821084 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8d39d69a-8696-4791-ad40-1636e0f1a954 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:55.822774 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8d39d69a-8696-4791-ad40-1636e0f1a954 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:55.824073 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8d39d69a-8696-4791-ad40-1636e0f1a954 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.185015 Nov 19 03:23:55.824653 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 361/669] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:55 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:23:55.912461 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9a9b88f1-f510-4a45-8ba9-8e11590d08e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:55.913064 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9a9b88f1-f510-4a45-8ba9-8e11590d08e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:55.919633 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a9b88f1-f510-4a45-8ba9-8e11590d08e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:55.920195 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a9b88f1-f510-4a45-8ba9-8e11590d08e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:55.921441 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a9b88f1-f510-4a45-8ba9-8e11590d08e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:55.922156 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a9b88f1-f510-4a45-8ba9-8e11590d08e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:55.956659 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a9b88f1-f510-4a45-8ba9-8e11590d08e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:55.957101 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a9b88f1-f510-4a45-8ba9-8e11590d08e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:55.957540 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-9a9b88f1-f510-4a45-8ba9-8e11590d08e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:55.998902 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9a9b88f1-f510-4a45-8ba9-8e11590d08e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:56.008374 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9a9b88f1-f510-4a45-8ba9-8e11590d08e7 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.099828 Nov 19 03:23:56.008889 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 362/670] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:55 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:56.655186 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-87a32151-6e0a-4d24-9a50-b2945f329931 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:56.655793 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-87a32151-6e0a-4d24-9a50-b2945f329931 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:56.661929 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-87a32151-6e0a-4d24-9a50-b2945f329931 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:56.662383 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-87a32151-6e0a-4d24-9a50-b2945f329931 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:56.663192 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-87a32151-6e0a-4d24-9a50-b2945f329931 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:56.663630 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-87a32151-6e0a-4d24-9a50-b2945f329931 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:56.814580 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-87a32151-6e0a-4d24-9a50-b2945f329931 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:56.822919 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-87a32151-6e0a-4d24-9a50-b2945f329931 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.172124 Nov 19 03:23:56.823503 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 363/671] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:56 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:56.844516 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5815c949-2fba-463d-856d-b358191d6952 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:56.845230 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5815c949-2fba-463d-856d-b358191d6952 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:56.851353 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5815c949-2fba-463d-856d-b358191d6952 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:56.851801 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5815c949-2fba-463d-856d-b358191d6952 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:56.852581 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5815c949-2fba-463d-856d-b358191d6952 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:56.853013 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5815c949-2fba-463d-856d-b358191d6952 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:57.004350 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5815c949-2fba-463d-856d-b358191d6952 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:57.022367 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5815c949-2fba-463d-856d-b358191d6952 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:57.022367 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5815c949-2fba-463d-856d-b358191d6952 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:57.022367 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5815c949-2fba-463d-856d-b358191d6952 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.179507 Nov 19 03:23:57.026335 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 364/672] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:56 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:23:57.033659 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-19463f1f-7e7d-428c-877f-83627e63febc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:57.034518 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-19463f1f-7e7d-428c-877f-83627e63febc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:57.040650 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-19463f1f-7e7d-428c-877f-83627e63febc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:57.041110 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-19463f1f-7e7d-428c-877f-83627e63febc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:57.041897 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-19463f1f-7e7d-428c-877f-83627e63febc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:57.042333 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-19463f1f-7e7d-428c-877f-83627e63febc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:57.075950 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-19463f1f-7e7d-428c-877f-83627e63febc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:57.075950 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-19463f1f-7e7d-428c-877f-83627e63febc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:57.076319 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-19463f1f-7e7d-428c-877f-83627e63febc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:57.116001 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-19463f1f-7e7d-428c-877f-83627e63febc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:57.123403 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-19463f1f-7e7d-428c-877f-83627e63febc tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.093376 Nov 19 03:23:57.124011 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 365/673] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:57 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:57.839705 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7a3261a3-fddb-4873-ba08-b4d37760b0cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:57.840482 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7a3261a3-fddb-4873-ba08-b4d37760b0cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:57.847964 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7a3261a3-fddb-4873-ba08-b4d37760b0cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:57.848411 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7a3261a3-fddb-4873-ba08-b4d37760b0cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:57.849214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7a3261a3-fddb-4873-ba08-b4d37760b0cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:57.849641 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7a3261a3-fddb-4873-ba08-b4d37760b0cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:57.994167 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7a3261a3-fddb-4873-ba08-b4d37760b0cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:58.001540 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7a3261a3-fddb-4873-ba08-b4d37760b0cd tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.165425 Nov 19 03:23:58.002109 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 366/674] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:57 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:58.037832 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7113e861-76c1-4493-837c-060e1396abca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:58.038435 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7113e861-76c1-4493-837c-060e1396abca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:58.047139 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7113e861-76c1-4493-837c-060e1396abca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:58.047600 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7113e861-76c1-4493-837c-060e1396abca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:58.048391 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7113e861-76c1-4493-837c-060e1396abca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:58.048824 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7113e861-76c1-4493-837c-060e1396abca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:58.218122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7113e861-76c1-4493-837c-060e1396abca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:58.227075 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7113e861-76c1-4493-837c-060e1396abca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:58.228975 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7113e861-76c1-4493-837c-060e1396abca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:58.230892 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7113e861-76c1-4493-837c-060e1396abca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.196367 Nov 19 03:23:58.231461 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 367/675] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:58 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:23:58.235710 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-990fa697-3220-4fc9-bc06-a62ce2f1ec25 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:58.236306 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-990fa697-3220-4fc9-bc06-a62ce2f1ec25 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:58.241886 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-990fa697-3220-4fc9-bc06-a62ce2f1ec25 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:58.242334 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-990fa697-3220-4fc9-bc06-a62ce2f1ec25 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:58.243164 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-990fa697-3220-4fc9-bc06-a62ce2f1ec25 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:58.243582 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-990fa697-3220-4fc9-bc06-a62ce2f1ec25 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:58.278529 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-990fa697-3220-4fc9-bc06-a62ce2f1ec25 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:58.279173 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-990fa697-3220-4fc9-bc06-a62ce2f1ec25 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:58.279848 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-990fa697-3220-4fc9-bc06-a62ce2f1ec25 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:58.323916 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-990fa697-3220-4fc9-bc06-a62ce2f1ec25 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:58.332576 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-990fa697-3220-4fc9-bc06-a62ce2f1ec25 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.100054 Nov 19 03:23:58.333351 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 368/676] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:58 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:23:59.018521 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-53485890-4062-4d16-98e1-85cd3b3c302f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:59.019251 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-53485890-4062-4d16-98e1-85cd3b3c302f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:59.025311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-53485890-4062-4d16-98e1-85cd3b3c302f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:59.025752 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-53485890-4062-4d16-98e1-85cd3b3c302f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:59.026545 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-53485890-4062-4d16-98e1-85cd3b3c302f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:59.027028 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-53485890-4062-4d16-98e1-85cd3b3c302f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:59.162682 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-53485890-4062-4d16-98e1-85cd3b3c302f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:59.169774 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-53485890-4062-4d16-98e1-85cd3b3c302f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.155028 Nov 19 03:23:59.171080 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 369/677] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:59 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:23:59.248780 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-97c7c69e-0db1-4539-b484-387b13d3cc69 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:59.249407 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-97c7c69e-0db1-4539-b484-387b13d3cc69 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:59.255453 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97c7c69e-0db1-4539-b484-387b13d3cc69 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:59.255905 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97c7c69e-0db1-4539-b484-387b13d3cc69 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:59.256681 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97c7c69e-0db1-4539-b484-387b13d3cc69 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:59.257116 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97c7c69e-0db1-4539-b484-387b13d3cc69 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:59.385401 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-97c7c69e-0db1-4539-b484-387b13d3cc69 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:59.394116 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-97c7c69e-0db1-4539-b484-387b13d3cc69 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:59.395611 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-97c7c69e-0db1-4539-b484-387b13d3cc69 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:59.396748 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-97c7c69e-0db1-4539-b484-387b13d3cc69 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.151780 Nov 19 03:23:59.397310 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 370/678] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:23:59 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:23:59.401372 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-da2ebeb6-78f3-4b4a-964b-937af8de0da4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:23:59.401969 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-da2ebeb6-78f3-4b4a-964b-937af8de0da4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:23:59.408270 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da2ebeb6-78f3-4b4a-964b-937af8de0da4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:59.408712 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da2ebeb6-78f3-4b4a-964b-937af8de0da4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:59.409482 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da2ebeb6-78f3-4b4a-964b-937af8de0da4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:59.409913 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da2ebeb6-78f3-4b4a-964b-937af8de0da4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:59.438940 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da2ebeb6-78f3-4b4a-964b-937af8de0da4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:23:59.439384 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da2ebeb6-78f3-4b4a-964b-937af8de0da4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:23:59.439830 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-da2ebeb6-78f3-4b4a-964b-937af8de0da4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:23:59.478501 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-da2ebeb6-78f3-4b4a-964b-937af8de0da4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:23:59.485653 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-da2ebeb6-78f3-4b4a-964b-937af8de0da4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.087426 Nov 19 03:23:59.486217 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 371/679] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:23:59 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:00.187048 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6bd13a8c-d4e0-4387-a820-fd3b9ccbf83d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:00.187806 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6bd13a8c-d4e0-4387-a820-fd3b9ccbf83d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:00.194430 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6bd13a8c-d4e0-4387-a820-fd3b9ccbf83d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:00.194902 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6bd13a8c-d4e0-4387-a820-fd3b9ccbf83d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:00.195664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6bd13a8c-d4e0-4387-a820-fd3b9ccbf83d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:00.196090 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6bd13a8c-d4e0-4387-a820-fd3b9ccbf83d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:00.328216 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6bd13a8c-d4e0-4387-a820-fd3b9ccbf83d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:00.335403 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6bd13a8c-d4e0-4387-a820-fd3b9ccbf83d tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.151977 Nov 19 03:24:00.335965 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 372/680] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:00 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:24:00.414452 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8ec2beb4-33c2-47e8-95a9-6d8b48bde0a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:00.415073 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8ec2beb4-33c2-47e8-95a9-6d8b48bde0a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:00.421210 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8ec2beb4-33c2-47e8-95a9-6d8b48bde0a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:00.421657 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8ec2beb4-33c2-47e8-95a9-6d8b48bde0a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:00.423040 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8ec2beb4-33c2-47e8-95a9-6d8b48bde0a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:00.423474 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8ec2beb4-33c2-47e8-95a9-6d8b48bde0a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:00.556724 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8ec2beb4-33c2-47e8-95a9-6d8b48bde0a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:00.564917 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8ec2beb4-33c2-47e8-95a9-6d8b48bde0a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:00.566373 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8ec2beb4-33c2-47e8-95a9-6d8b48bde0a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:00.567542 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8ec2beb4-33c2-47e8-95a9-6d8b48bde0a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.156574 Nov 19 03:24:00.568097 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 373/681] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:00 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:24:00.572335 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9117fc60-3ba4-4a73-b7a5-47048be1c37f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:00.572919 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9117fc60-3ba4-4a73-b7a5-47048be1c37f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:00.578510 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9117fc60-3ba4-4a73-b7a5-47048be1c37f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:00.579067 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9117fc60-3ba4-4a73-b7a5-47048be1c37f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:00.579985 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9117fc60-3ba4-4a73-b7a5-47048be1c37f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:00.580414 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9117fc60-3ba4-4a73-b7a5-47048be1c37f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:00.610949 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9117fc60-3ba4-4a73-b7a5-47048be1c37f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:00.611392 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9117fc60-3ba4-4a73-b7a5-47048be1c37f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:00.611830 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-9117fc60-3ba4-4a73-b7a5-47048be1c37f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:24:00.649764 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9117fc60-3ba4-4a73-b7a5-47048be1c37f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:00.657723 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9117fc60-3ba4-4a73-b7a5-47048be1c37f tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.088619 Nov 19 03:24:00.658281 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 374/682] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:00 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:01.352169 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a4397352-26bb-456b-9f71-96b4d889e4b3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:01.352802 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a4397352-26bb-456b-9f71-96b4d889e4b3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:01.358877 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a4397352-26bb-456b-9f71-96b4d889e4b3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:01.359349 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a4397352-26bb-456b-9f71-96b4d889e4b3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:01.360215 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a4397352-26bb-456b-9f71-96b4d889e4b3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:01.360641 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a4397352-26bb-456b-9f71-96b4d889e4b3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:01.453878 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-af447772-638d-49a3-b999-02cb04290aa8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 30139 microversion: 2.1 time: 16.450038 Nov 19 03:24:01.455248 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 309/683] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:23:45 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 30139 bytes in 16453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:24:01.583376 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a4397352-26bb-456b-9f71-96b4d889e4b3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:01.586284 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a28c59d3-954b-408d-bcd2-218c7a214595 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:01.588969 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a28c59d3-954b-408d-bcd2-218c7a214595 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:01.592527 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a4397352-26bb-456b-9f71-96b4d889e4b3 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1515 microversion: 2.1 time: 0.243986 Nov 19 03:24:01.593564 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 375/684] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:01 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:24:01.595676 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a28c59d3-954b-408d-bcd2-218c7a214595 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:01.596130 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a28c59d3-954b-408d-bcd2-218c7a214595 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:01.596901 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a28c59d3-954b-408d-bcd2-218c7a214595 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:01.597334 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a28c59d3-954b-408d-bcd2-218c7a214595 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:01.675207 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e7b29abb-2e78-4fef-9aa4-061ddec9b9c4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:01.675816 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e7b29abb-2e78-4fef-9aa4-061ddec9b9c4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:01.681511 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e7b29abb-2e78-4fef-9aa4-061ddec9b9c4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:01.681957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e7b29abb-2e78-4fef-9aa4-061ddec9b9c4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:01.682763 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e7b29abb-2e78-4fef-9aa4-061ddec9b9c4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:01.683203 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e7b29abb-2e78-4fef-9aa4-061ddec9b9c4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:01.715397 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e7b29abb-2e78-4fef-9aa4-061ddec9b9c4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:01.715848 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e7b29abb-2e78-4fef-9aa4-061ddec9b9c4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:01.716296 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-e7b29abb-2e78-4fef-9aa4-061ddec9b9c4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lazy-loading 'fault' on Instance uuid b19ae39a-79ce-4adb-9ee4-595daa1a8d27 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:24:01.779700 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e7b29abb-2e78-4fef-9aa4-061ddec9b9c4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5de23e7d52489dbf22a5e9d5d6a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee26dbde283f45a58a18f8435596e63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:01.787444 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e7b29abb-2e78-4fef-9aa4-061ddec9b9c4 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 200 len: 1312 microversion: 2.1 time: 0.116312 Nov 19 03:24:01.788032 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 376/685] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:01 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:24:01.854984 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a28c59d3-954b-408d-bcd2-218c7a214595 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:01.864375 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a28c59d3-954b-408d-bcd2-218c7a214595 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:01.866114 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a28c59d3-954b-408d-bcd2-218c7a214595 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:01.867431 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a28c59d3-954b-408d-bcd2-218c7a214595 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.284973 Nov 19 03:24:01.867989 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 310/686] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:01 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:24:02.051649 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-74a20b46-487d-4799-8a6c-cbd78b29b290 req-e801d215-778f-482c-9a13-68af07f2e76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824fcf10-8c9b-461d-8206-1c9ae5d4011b", "name": "network-vif-deleted", "tag": "004bc3b2-8042-48ab-abde-62fc17b827d2"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:02.053655 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:24:02.053655 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:24:02.062462 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-74a20b46-487d-4799-8a6c-cbd78b29b290 req-e801d215-778f-482c-9a13-68af07f2e76f service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:02.062938 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-74a20b46-487d-4799-8a6c-cbd78b29b290 req-e801d215-778f-482c-9a13-68af07f2e76f service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:02.074456 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-74a20b46-487d-4799-8a6c-cbd78b29b290 req-e801d215-778f-482c-9a13-68af07f2e76f service nova] Creating event network-vif-deleted:004bc3b2-8042-48ab-abde-62fc17b827d2 for instance 824fcf10-8c9b-461d-8206-1c9ae5d4011b on hv-cinder-81803 Nov 19 03:24:02.080382 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-74a20b46-487d-4799-8a6c-cbd78b29b290 req-e801d215-778f-482c-9a13-68af07f2e76f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032261 Nov 19 03:24:02.081137 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 377/687] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:24:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:02.466318 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1de7ae2a-4c12-4300-b26f-e409bbd984cc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:02.467246 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1de7ae2a-4c12-4300-b26f-e409bbd984cc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:02.474858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1de7ae2a-4c12-4300-b26f-e409bbd984cc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:02.475303 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1de7ae2a-4c12-4300-b26f-e409bbd984cc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:02.476065 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1de7ae2a-4c12-4300-b26f-e409bbd984cc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:02.476494 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1de7ae2a-4c12-4300-b26f-e409bbd984cc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:02.577804 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1de7ae2a-4c12-4300-b26f-e409bbd984cc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 31820 microversion: 2.1 time: 0.115494 Nov 19 03:24:02.579346 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 311/688] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:24:02 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 31820 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:24:02.610359 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-51228063-89db-4064-b880-8ac00fab6003 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:02.611149 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-51228063-89db-4064-b880-8ac00fab6003 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:02.616933 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51228063-89db-4064-b880-8ac00fab6003 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:02.617375 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51228063-89db-4064-b880-8ac00fab6003 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:02.618141 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51228063-89db-4064-b880-8ac00fab6003 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:02.618751 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51228063-89db-4064-b880-8ac00fab6003 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:02.653963 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51228063-89db-4064-b880-8ac00fab6003 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:02.654407 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-51228063-89db-4064-b880-8ac00fab6003 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:02.655005 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-51228063-89db-4064-b880-8ac00fab6003 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lazy-loading 'fault' on Instance uuid 824fcf10-8c9b-461d-8206-1c9ae5d4011b {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:24:02.698491 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-51228063-89db-4064-b880-8ac00fab6003 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:02.707189 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-51228063-89db-4064-b880-8ac00fab6003 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 200 len: 1308 microversion: 2.1 time: 0.101499 Nov 19 03:24:02.707956 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 378/689] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:02 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:02.804333 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e50a0f2b-b701-4964-a019-dbcdb1d4f342 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:02.804940 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e50a0f2b-b701-4964-a019-dbcdb1d4f342 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] [instance: b19ae39a-79ce-4adb-9ee4-595daa1a8d27] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:02.812081 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e50a0f2b-b701-4964-a019-dbcdb1d4f342 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:02.813091 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e50a0f2b-b701-4964-a019-dbcdb1d4f342 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:02.814003 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e50a0f2b-b701-4964-a019-dbcdb1d4f342 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:02.814430 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e50a0f2b-b701-4964-a019-dbcdb1d4f342 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:02.829196 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-e50a0f2b-b701-4964-a019-dbcdb1d4f342 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] HTTP exception thrown: Instance b19ae39a-79ce-4adb-9ee4-595daa1a8d27 could not be found. Nov 19 03:24:02.829773 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e50a0f2b-b701-4964-a019-dbcdb1d4f342 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] Returning 404 to user: Instance b19ae39a-79ce-4adb-9ee4-595daa1a8d27 could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:24:02.830597 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e50a0f2b-b701-4964-a019-dbcdb1d4f342 tempest-ServerRescueNegativeTestJSON-507561084 tempest-ServerRescueNegativeTestJSON-507561084-project] 10.222.0.47 "GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27" status: 404 len: 111 microversion: 2.1 time: 0.030350 Nov 19 03:24:02.831114 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 312/690] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:02 2021] GET /compute/v2.1/servers/b19ae39a-79ce-4adb-9ee4-595daa1a8d27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:24:02.886549 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-dabc90b6-4512-4e90-ab3d-02846d310c5f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:02.887146 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-dabc90b6-4512-4e90-ab3d-02846d310c5f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:02.893438 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dabc90b6-4512-4e90-ab3d-02846d310c5f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:02.893876 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dabc90b6-4512-4e90-ab3d-02846d310c5f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:02.894671 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dabc90b6-4512-4e90-ab3d-02846d310c5f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:02.895099 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dabc90b6-4512-4e90-ab3d-02846d310c5f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:03.148006 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-dabc90b6-4512-4e90-ab3d-02846d310c5f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:03.156504 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-dabc90b6-4512-4e90-ab3d-02846d310c5f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:03.159020 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-dabc90b6-4512-4e90-ab3d-02846d310c5f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:03.160168 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-dabc90b6-4512-4e90-ab3d-02846d310c5f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.277318 Nov 19 03:24:03.161024 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 379/691] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:02 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:24:03.590163 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1e587d2b-306b-4d14-8395-11cf0a8f365f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:03.591235 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1e587d2b-306b-4d14-8395-11cf0a8f365f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:03.598051 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1e587d2b-306b-4d14-8395-11cf0a8f365f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:03.598512 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1e587d2b-306b-4d14-8395-11cf0a8f365f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:03.599300 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1e587d2b-306b-4d14-8395-11cf0a8f365f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:03.599734 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1e587d2b-306b-4d14-8395-11cf0a8f365f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:03.716775 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1e587d2b-306b-4d14-8395-11cf0a8f365f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 33310 microversion: 2.1 time: 0.129985 Nov 19 03:24:03.717343 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 313/692] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:24:03 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 33310 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:24:03.724864 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-01dda969-dca2-435e-88a1-a5134bf1dc50 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:03.725470 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-01dda969-dca2-435e-88a1-a5134bf1dc50 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 824fcf10-8c9b-461d-8206-1c9ae5d4011b] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:03.732494 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-01dda969-dca2-435e-88a1-a5134bf1dc50 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:03.733040 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-01dda969-dca2-435e-88a1-a5134bf1dc50 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:03.733965 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-01dda969-dca2-435e-88a1-a5134bf1dc50 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:03.735077 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-01dda969-dca2-435e-88a1-a5134bf1dc50 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:03.748701 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-01dda969-dca2-435e-88a1-a5134bf1dc50 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] HTTP exception thrown: Instance 824fcf10-8c9b-461d-8206-1c9ae5d4011b could not be found. Nov 19 03:24:03.749294 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-01dda969-dca2-435e-88a1-a5134bf1dc50 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Returning 404 to user: Instance 824fcf10-8c9b-461d-8206-1c9ae5d4011b could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:24:03.750122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-01dda969-dca2-435e-88a1-a5134bf1dc50 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b" status: 404 len: 111 microversion: 2.1 time: 0.028854 Nov 19 03:24:03.750706 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 380/693] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:03 2021] GET /compute/v2.1/servers/824fcf10-8c9b-461d-8206-1c9ae5d4011b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:24:04.178682 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-21fa66e7-a570-4c4c-b321-eeff62084922 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:04.179470 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-21fa66e7-a570-4c4c-b321-eeff62084922 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:04.186588 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-21fa66e7-a570-4c4c-b321-eeff62084922 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:04.187037 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-21fa66e7-a570-4c4c-b321-eeff62084922 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:04.188758 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-21fa66e7-a570-4c4c-b321-eeff62084922 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:04.189215 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-21fa66e7-a570-4c4c-b321-eeff62084922 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:04.414851 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-21fa66e7-a570-4c4c-b321-eeff62084922 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:04.423733 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-21fa66e7-a570-4c4c-b321-eeff62084922 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:04.425223 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-21fa66e7-a570-4c4c-b321-eeff62084922 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:04.426369 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-21fa66e7-a570-4c4c-b321-eeff62084922 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.251976 Nov 19 03:24:04.426962 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 314/694] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:04 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:24:04.729153 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3c0cbaa1-4720-4a2c-9207-725d834c7e2b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:04.730774 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3c0cbaa1-4720-4a2c-9207-725d834c7e2b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:04.737761 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3c0cbaa1-4720-4a2c-9207-725d834c7e2b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:04.738203 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3c0cbaa1-4720-4a2c-9207-725d834c7e2b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:04.739013 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3c0cbaa1-4720-4a2c-9207-725d834c7e2b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:04.739445 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3c0cbaa1-4720-4a2c-9207-725d834c7e2b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:04.846445 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3c0cbaa1-4720-4a2c-9207-725d834c7e2b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 34053 microversion: 2.1 time: 0.120711 Nov 19 03:24:04.847056 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 381/695] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:24:04 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 34053 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:24:04.895169 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0d97e904-8a1f-4976-b7c5-ca4188f3acbb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:04.895771 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0d97e904-8a1f-4976-b7c5-ca4188f3acbb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:04.903145 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0d97e904-8a1f-4976-b7c5-ca4188f3acbb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:04.903668 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0d97e904-8a1f-4976-b7c5-ca4188f3acbb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:04.904451 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0d97e904-8a1f-4976-b7c5-ca4188f3acbb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:04.904883 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0d97e904-8a1f-4976-b7c5-ca4188f3acbb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:04.930951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0d97e904-8a1f-4976-b7c5-ca4188f3acbb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Going to try to terminate instance {{(pid=116066) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:24:05.011903 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0d97e904-8a1f-4976-b7c5-ca4188f3acbb tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 204 len: 0 microversion: 2.1 time: 0.120799 Nov 19 03:24:05.012796 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 315/696] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:24:04 2021] DELETE /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:24:05.022710 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-204a2315-20b2-4bfb-ba87-067e4b5f3a17 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:05.023537 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-204a2315-20b2-4bfb-ba87-067e4b5f3a17 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:05.030567 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-204a2315-20b2-4bfb-ba87-067e4b5f3a17 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:05.031147 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-204a2315-20b2-4bfb-ba87-067e4b5f3a17 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:05.032317 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-204a2315-20b2-4bfb-ba87-067e4b5f3a17 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:05.032823 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-204a2315-20b2-4bfb-ba87-067e4b5f3a17 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:05.214993 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-204a2315-20b2-4bfb-ba87-067e4b5f3a17 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:05.222534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-204a2315-20b2-4bfb-ba87-067e4b5f3a17 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1512 microversion: 2.1 time: 0.204450 Nov 19 03:24:05.223314 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 382/697] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:05 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:05.445625 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8ea5bc1f-0327-4074-b310-2a342d6ad49e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:05.446533 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8ea5bc1f-0327-4074-b310-2a342d6ad49e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:05.453086 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8ea5bc1f-0327-4074-b310-2a342d6ad49e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:05.454862 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8ea5bc1f-0327-4074-b310-2a342d6ad49e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:05.455691 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8ea5bc1f-0327-4074-b310-2a342d6ad49e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:05.456182 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8ea5bc1f-0327-4074-b310-2a342d6ad49e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:05.595829 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8ea5bc1f-0327-4074-b310-2a342d6ad49e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:05.604092 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8ea5bc1f-0327-4074-b310-2a342d6ad49e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:05.605562 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8ea5bc1f-0327-4074-b310-2a342d6ad49e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:05.606756 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8ea5bc1f-0327-4074-b310-2a342d6ad49e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.165629 Nov 19 03:24:05.607535 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 316/698] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:05 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:24:05.858166 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ad56b7de-5750-4e3d-b8be-fb02cb547757 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:05.859208 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ad56b7de-5750-4e3d-b8be-fb02cb547757 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:05.866311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ad56b7de-5750-4e3d-b8be-fb02cb547757 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:05.866788 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ad56b7de-5750-4e3d-b8be-fb02cb547757 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:05.867572 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ad56b7de-5750-4e3d-b8be-fb02cb547757 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:05.868004 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ad56b7de-5750-4e3d-b8be-fb02cb547757 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:05.975733 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ad56b7de-5750-4e3d-b8be-fb02cb547757 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 35140 microversion: 2.1 time: 0.120888 Nov 19 03:24:05.976392 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 383/699] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:24:05 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 35140 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:24:06.240685 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-30d931bc-a582-49bb-9c1b-4ba96480ec4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:06.242093 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-30d931bc-a582-49bb-9c1b-4ba96480ec4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:06.254633 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-30d931bc-a582-49bb-9c1b-4ba96480ec4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:06.255193 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-30d931bc-a582-49bb-9c1b-4ba96480ec4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:06.256114 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-30d931bc-a582-49bb-9c1b-4ba96480ec4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:06.256638 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-30d931bc-a582-49bb-9c1b-4ba96480ec4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:06.392788 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-30d931bc-a582-49bb-9c1b-4ba96480ec4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:06.400108 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-30d931bc-a582-49bb-9c1b-4ba96480ec4f tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1512 microversion: 2.1 time: 0.164171 Nov 19 03:24:06.400677 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 317/700] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:06 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:24:06.626407 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a7a0b7fa-c78a-4707-a4d0-cae498bdcfc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:06.627156 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a7a0b7fa-c78a-4707-a4d0-cae498bdcfc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:06.634016 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a7a0b7fa-c78a-4707-a4d0-cae498bdcfc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:06.634490 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a7a0b7fa-c78a-4707-a4d0-cae498bdcfc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:06.635508 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a7a0b7fa-c78a-4707-a4d0-cae498bdcfc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:06.635947 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a7a0b7fa-c78a-4707-a4d0-cae498bdcfc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:06.776311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a7a0b7fa-c78a-4707-a4d0-cae498bdcfc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:06.787237 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a7a0b7fa-c78a-4707-a4d0-cae498bdcfc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:06.788964 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a7a0b7fa-c78a-4707-a4d0-cae498bdcfc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:06.790142 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a7a0b7fa-c78a-4707-a4d0-cae498bdcfc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.168550 Nov 19 03:24:06.790729 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 384/701] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:06 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:24:06.988940 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0430ee4d-ae7e-43db-b65a-2373c201d177 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:06.990001 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0430ee4d-ae7e-43db-b65a-2373c201d177 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:06.997132 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0430ee4d-ae7e-43db-b65a-2373c201d177 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:06.997587 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0430ee4d-ae7e-43db-b65a-2373c201d177 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:06.999662 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0430ee4d-ae7e-43db-b65a-2373c201d177 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:06.999662 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0430ee4d-ae7e-43db-b65a-2373c201d177 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:07.148025 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0430ee4d-ae7e-43db-b65a-2373c201d177 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 36430 microversion: 2.1 time: 0.163452 Nov 19 03:24:07.148798 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 318/702] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:24:06 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 36430 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:24:07.416784 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f4d86765-0fe3-4a30-b527-ff6100cfbf70 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:07.418045 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f4d86765-0fe3-4a30-b527-ff6100cfbf70 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:07.425010 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4d86765-0fe3-4a30-b527-ff6100cfbf70 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:07.425326 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4d86765-0fe3-4a30-b527-ff6100cfbf70 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:07.426315 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4d86765-0fe3-4a30-b527-ff6100cfbf70 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:07.426782 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4d86765-0fe3-4a30-b527-ff6100cfbf70 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:07.653371 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f4d86765-0fe3-4a30-b527-ff6100cfbf70 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96438e8630f848a8879dbd29e687d1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53690eedb4c749db94ed55f64a323cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:07.661146 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f4d86765-0fe3-4a30-b527-ff6100cfbf70 tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 200 len: 1512 microversion: 2.1 time: 0.247917 Nov 19 03:24:07.661858 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 385/703] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:07 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:07.688657 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-27436949-32f6-4610-939f-9bdddd106c75 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Action: 'create', calling method: .version_select at 0x7f845a187670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-90594382"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:07.808891 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1891b676-eb8c-4081-bc33-c73a8578cba2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:07.811615 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1891b676-eb8c-4081-bc33-c73a8578cba2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:07.827446 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1891b676-eb8c-4081-bc33-c73a8578cba2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:07.829868 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1891b676-eb8c-4081-bc33-c73a8578cba2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:07.830839 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1891b676-eb8c-4081-bc33-c73a8578cba2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:07.832049 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1891b676-eb8c-4081-bc33-c73a8578cba2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:08.001210 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1891b676-eb8c-4081-bc33-c73a8578cba2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:08.004564 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-27436949-32f6-4610-939f-9bdddd106c75 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.433444 Nov 19 03:24:08.005388 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 319/704] 10.222.0.47 () {60 vars in 1154 bytes} [Fri Nov 19 03:24:07 2021] POST /compute/v2.1/os-volumes => generated 343 bytes in 435 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 19 03:24:08.010320 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-a69eeff9-78e5-4aab-bce9-a77589656e3d req-efb4a749-8030-45df-9aff-ebb77f1f67ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2fd56f-4c3a-4229-9b89-1f4c765c04d4", "name": "network-vif-deleted", "tag": "e9c16595-10bc-456b-bed0-df7470f9741d"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:08.011974 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1891b676-eb8c-4081-bc33-c73a8578cba2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:08.012263 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:24:08.012263 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:24:08.013550 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1891b676-eb8c-4081-bc33-c73a8578cba2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:08.014759 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1891b676-eb8c-4081-bc33-c73a8578cba2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.209578 Nov 19 03:24:08.015932 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 386/705] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:07 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:24:08.020649 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1e6cb3e3-42a5-4705-af04-dc39f7f08df2 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a15ec10>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:08.031713 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-a69eeff9-78e5-4aab-bce9-a77589656e3d req-efb4a749-8030-45df-9aff-ebb77f1f67ed service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:08.032415 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-a69eeff9-78e5-4aab-bce9-a77589656e3d req-efb4a749-8030-45df-9aff-ebb77f1f67ed service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:08.043995 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-a69eeff9-78e5-4aab-bce9-a77589656e3d req-efb4a749-8030-45df-9aff-ebb77f1f67ed service nova] Creating event network-vif-deleted:e9c16595-10bc-456b-bed0-df7470f9741d for instance 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 on hv-cinder-81803 Nov 19 03:24:08.049409 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-a69eeff9-78e5-4aab-bce9-a77589656e3d req-efb4a749-8030-45df-9aff-ebb77f1f67ed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042814 Nov 19 03:24:08.050043 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 320/706] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:24:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:08.074161 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1e6cb3e3-42a5-4705-af04-dc39f7f08df2 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c" status: 200 len: 343 microversion: 2.1 time: 0.057118 Nov 19 03:24:08.074767 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 387/707] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:24:08 2021] GET /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c => generated 343 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:08.161437 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ead1feba-ac5c-40ea-bf49-2a7061c5bc2d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:08.162419 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ead1feba-ac5c-40ea-bf49-2a7061c5bc2d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:08.168447 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ead1feba-ac5c-40ea-bf49-2a7061c5bc2d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:08.168896 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ead1feba-ac5c-40ea-bf49-2a7061c5bc2d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:08.169664 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ead1feba-ac5c-40ea-bf49-2a7061c5bc2d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:08.170094 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ead1feba-ac5c-40ea-bf49-2a7061c5bc2d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:08.269342 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ead1feba-ac5c-40ea-bf49-2a7061c5bc2d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 37810 microversion: 2.1 time: 0.112886 Nov 19 03:24:08.269970 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 321/708] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:24:08 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 37810 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:24:08.678561 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0f5add93-3246-47be-8d2f-05374829427e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:08.679083 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0f5add93-3246-47be-8d2f-05374829427e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] [instance: 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:08.685054 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0f5add93-3246-47be-8d2f-05374829427e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:08.685499 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0f5add93-3246-47be-8d2f-05374829427e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:08.686271 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0f5add93-3246-47be-8d2f-05374829427e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:08.686732 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0f5add93-3246-47be-8d2f-05374829427e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:08.700004 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-0f5add93-3246-47be-8d2f-05374829427e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] HTTP exception thrown: Instance 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 could not be found. Nov 19 03:24:08.700577 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0f5add93-3246-47be-8d2f-05374829427e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] Returning 404 to user: Instance 3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:24:08.701386 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0f5add93-3246-47be-8d2f-05374829427e tempest-AttachVolumeNegativeTest-975474354 tempest-AttachVolumeNegativeTest-975474354-project] 10.222.0.47 "GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4" status: 404 len: 111 microversion: 2.1 time: 0.027102 Nov 19 03:24:08.701906 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 388/709] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:08 2021] GET /compute/v2.1/servers/3c2fd56f-4c3a-4229-9b89-1f4c765c04d4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:24:09.034465 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d49312ee-a326-4dda-8c28-a13833a5b489 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:09.035187 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d49312ee-a326-4dda-8c28-a13833a5b489 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:09.042043 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d49312ee-a326-4dda-8c28-a13833a5b489 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:09.042511 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d49312ee-a326-4dda-8c28-a13833a5b489 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:09.043296 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d49312ee-a326-4dda-8c28-a13833a5b489 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:09.043732 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d49312ee-a326-4dda-8c28-a13833a5b489 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:09.086365 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-883a484e-827e-49bd-bb4b-d54d2f9e2875 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a0548b0>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:09.132330 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-883a484e-827e-49bd-bb4b-d54d2f9e2875 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c" status: 200 len: 344 microversion: 2.1 time: 0.049526 Nov 19 03:24:09.132911 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 389/710] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:24:09 2021] GET /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:24:09.143704 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3771d494-c818-4771-840b-7dcf4818a9eb tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Action: 'create', calling method: .version_select at 0x7f845aab1790>, body: {"snapshot": {"volume_id": "ca5e2053-3799-4d21-9b6a-8d689f89329c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2095562955"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:09.279375 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d49312ee-a326-4dda-8c28-a13833a5b489 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:09.292698 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d49312ee-a326-4dda-8c28-a13833a5b489 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:09.296518 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3771d494-c818-4771-840b-7dcf4818a9eb tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.156274 Nov 19 03:24:09.297784 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 390/711] 10.222.0.47 () {60 vars in 1161 bytes} [Fri Nov 19 03:24:09 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:24:09.303028 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1d9c91b2-95ec-498b-bc37-30223c87fd6c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:09.304182 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1d9c91b2-95ec-498b-bc37-30223c87fd6c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:09.307618 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d49312ee-a326-4dda-8c28-a13833a5b489 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:09.308854 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d49312ee-a326-4dda-8c28-a13833a5b489 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.278700 Nov 19 03:24:09.320054 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 322/712] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:09 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:24:09.320054 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cd368b5c-094c-4f56-b701-09336270d8b7 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a1e0430>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:09.320238 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1d9c91b2-95ec-498b-bc37-30223c87fd6c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:09.320341 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1d9c91b2-95ec-498b-bc37-30223c87fd6c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:09.321115 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1d9c91b2-95ec-498b-bc37-30223c87fd6c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:09.321612 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1d9c91b2-95ec-498b-bc37-30223c87fd6c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:09.365076 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cd368b5c-094c-4f56-b701-09336270d8b7 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89" status: 200 len: 287 microversion: 2.1 time: 0.054575 Nov 19 03:24:09.365645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 323/713] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Nov 19 03:24:09 2021] GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:09.375491 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-29f5b7fd-97e3-4185-b46b-9d2d2ef08d61 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a1ad3a0>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:09.407229 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-29f5b7fd-97e3-4185-b46b-9d2d2ef08d61 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034923 Nov 19 03:24:09.407935 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 324/714] 10.222.0.47 () {58 vars in 1139 bytes} [Fri Nov 19 03:24:09 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:09.418162 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-69938050-1a3b-4924-b8c8-42955521b36e tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a1adee0>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:09.432227 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1d9c91b2-95ec-498b-bc37-30223c87fd6c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 38181 microversion: 2.1 time: 0.132719 Nov 19 03:24:09.432867 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 391/715] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:24:09 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 38181 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:24:09.449332 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-69938050-1a3b-4924-b8c8-42955521b36e tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89" status: 200 len: 287 microversion: 2.1 time: 0.034574 Nov 19 03:24:09.449898 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 325/716] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Nov 19 03:24:09 2021] GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:10.327666 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-bde2c728-9bc0-41df-b6ec-df281dffc39d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:10.329193 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-bde2c728-9bc0-41df-b6ec-df281dffc39d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:10.336001 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bde2c728-9bc0-41df-b6ec-df281dffc39d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:10.336455 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bde2c728-9bc0-41df-b6ec-df281dffc39d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:10.337237 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bde2c728-9bc0-41df-b6ec-df281dffc39d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:10.337674 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bde2c728-9bc0-41df-b6ec-df281dffc39d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:10.445066 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d7c8f0dc-c56f-474f-b979-acd2ec40e56d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:10.446701 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d7c8f0dc-c56f-474f-b979-acd2ec40e56d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:10.452536 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7c8f0dc-c56f-474f-b979-acd2ec40e56d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:10.453696 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7c8f0dc-c56f-474f-b979-acd2ec40e56d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:10.454643 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7c8f0dc-c56f-474f-b979-acd2ec40e56d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:10.455345 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7c8f0dc-c56f-474f-b979-acd2ec40e56d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:10.473998 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-bde2c728-9bc0-41df-b6ec-df281dffc39d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:10.482610 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-bde2c728-9bc0-41df-b6ec-df281dffc39d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:10.484679 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-bde2c728-9bc0-41df-b6ec-df281dffc39d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:10.485877 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-bde2c728-9bc0-41df-b6ec-df281dffc39d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.162244 Nov 19 03:24:10.486437 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 392/717] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:10 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:24:10.490678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f3d99e2b-edf8-4254-a1fb-270ee2f7112a tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a0d1c10>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:10.519468 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f3d99e2b-edf8-4254-a1fb-270ee2f7112a tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89" status: 200 len: 287 microversion: 2.1 time: 0.031994 Nov 19 03:24:10.520027 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 393/718] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Nov 19 03:24:10 2021] GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:11.505816 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-dbd2f644-f473-4171-9617-d03a4e32c6d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:11.506568 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-dbd2f644-f473-4171-9617-d03a4e32c6d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:11.513324 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dbd2f644-f473-4171-9617-d03a4e32c6d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:11.513769 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dbd2f644-f473-4171-9617-d03a4e32c6d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:11.514567 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dbd2f644-f473-4171-9617-d03a4e32c6d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:11.515002 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dbd2f644-f473-4171-9617-d03a4e32c6d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:11.648935 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-dbd2f644-f473-4171-9617-d03a4e32c6d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:11.657749 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-dbd2f644-f473-4171-9617-d03a4e32c6d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:11.659240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-dbd2f644-f473-4171-9617-d03a4e32c6d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:11.660374 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-dbd2f644-f473-4171-9617-d03a4e32c6d3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.159373 Nov 19 03:24:11.661126 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 394/719] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:11 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:24:11.665092 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-117af835-bfa4-4c86-86b2-b45fc52e9407 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a0033a0>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:11.698922 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-117af835-bfa4-4c86-86b2-b45fc52e9407 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89" status: 200 len: 287 microversion: 2.1 time: 0.036760 Nov 19 03:24:11.699494 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 395/720] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Nov 19 03:24:11 2021] GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:12.678867 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-09f96385-1d0a-490a-9174-156d04aba35b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:12.679605 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-09f96385-1d0a-490a-9174-156d04aba35b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:12.685546 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-09f96385-1d0a-490a-9174-156d04aba35b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:12.685991 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-09f96385-1d0a-490a-9174-156d04aba35b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:12.686796 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-09f96385-1d0a-490a-9174-156d04aba35b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:12.687229 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-09f96385-1d0a-490a-9174-156d04aba35b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:12.823177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-09f96385-1d0a-490a-9174-156d04aba35b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:12.831621 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-09f96385-1d0a-490a-9174-156d04aba35b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:12.833126 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-09f96385-1d0a-490a-9174-156d04aba35b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:12.834267 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-09f96385-1d0a-490a-9174-156d04aba35b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.159568 Nov 19 03:24:12.834856 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 396/721] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:12 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:24:12.838934 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-55682242-f1ab-4693-aeec-7c7c728150e2 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a0039d0>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:12.866734 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-55682242-f1ab-4693-aeec-7c7c728150e2 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89" status: 200 len: 287 microversion: 2.1 time: 0.030842 Nov 19 03:24:12.867285 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 397/722] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Nov 19 03:24:12 2021] GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89 => generated 287 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:13.760172 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d7c8f0dc-c56f-474f-b979-acd2ec40e56d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 38181 microversion: 2.1 time: 3.319104 Nov 19 03:24:13.763672 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 326/723] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:24:10 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 38181 bytes in 3321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:24:13.852788 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-55e56402-f76c-4fa8-b4c1-fde4f85b3171 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:13.856565 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-55e56402-f76c-4fa8-b4c1-fde4f85b3171 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:13.859326 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-55e56402-f76c-4fa8-b4c1-fde4f85b3171 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:13.859775 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-55e56402-f76c-4fa8-b4c1-fde4f85b3171 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:13.860545 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-55e56402-f76c-4fa8-b4c1-fde4f85b3171 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:13.860978 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-55e56402-f76c-4fa8-b4c1-fde4f85b3171 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:13.879185 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9d4bdaca-f3c5-4df8-a5dd-74f450954f92 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a1adc10>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:13.909136 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9d4bdaca-f3c5-4df8-a5dd-74f450954f92 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89" status: 200 len: 287 microversion: 2.1 time: 0.034476 Nov 19 03:24:13.909745 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 327/724] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Nov 19 03:24:13 2021] GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:24:13.991049 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-55e56402-f76c-4fa8-b4c1-fde4f85b3171 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:13.999370 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-55e56402-f76c-4fa8-b4c1-fde4f85b3171 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:14.001375 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-55e56402-f76c-4fa8-b4c1-fde4f85b3171 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:14.002577 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-55e56402-f76c-4fa8-b4c1-fde4f85b3171 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.154017 Nov 19 03:24:14.003132 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 398/725] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:13 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:24:14.772536 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a4e7a350-e52b-40fb-b3ca-a81dc8fd021c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:14.774106 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a4e7a350-e52b-40fb-b3ca-a81dc8fd021c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:14.780412 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a4e7a350-e52b-40fb-b3ca-a81dc8fd021c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:14.780855 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a4e7a350-e52b-40fb-b3ca-a81dc8fd021c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:14.782265 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a4e7a350-e52b-40fb-b3ca-a81dc8fd021c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:14.782728 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a4e7a350-e52b-40fb-b3ca-a81dc8fd021c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:14.871393 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9e7202b4-03fc-4c00-810c-48a5d2824050 tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] Calling method '.version_select at 0x7f845a003820>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:14.899602 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a4e7a350-e52b-40fb-b3ca-a81dc8fd021c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 38181 microversion: 2.1 time: 0.131034 Nov 19 03:24:14.900273 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 328/726] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:24:14 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 38181 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:24:14.917446 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9e7202b4-03fc-4c00-810c-48a5d2824050 tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6dfeeb44-5145-4ccd-b059-2b1b2305930a" status: 200 len: 351 microversion: 2.1 time: 0.049413 Nov 19 03:24:14.918054 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 399/727] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:24:14 2021] GET /compute/v2.1/os-volumes/6dfeeb44-5145-4ccd-b059-2b1b2305930a => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:24:14.921126 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-be7a9ebb-070a-4086-b001-f0726056a489 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a187940>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:14.951214 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-be7a9ebb-070a-4086-b001-f0726056a489 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89" status: 200 len: 288 microversion: 2.1 time: 0.033965 Nov 19 03:24:14.951780 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 329/728] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Nov 19 03:24:14 2021] GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:24:14.961381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-febe8b52-2efd-4464-a3ee-999e90a2c39e tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a003040>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:15.017812 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-febe8b52-2efd-4464-a3ee-999e90a2c39e tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89" status: 202 len: 0 microversion: 2.1 time: 0.059335 Nov 19 03:24:15.021107 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c05d07ce-090e-4da8-89d3-ee02d4279859 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:15.021832 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c05d07ce-090e-4da8-89d3-ee02d4279859 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:15.022358 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 400/729] 10.222.0.47 () {58 vars in 1253 bytes} [Fri Nov 19 03:24:14 2021] DELETE /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:24:15.028494 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-17d8f6e1-df08-4af7-8640-e05a1f930b4d tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a0a1af0>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:15.029479 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c05d07ce-090e-4da8-89d3-ee02d4279859 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:15.029927 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c05d07ce-090e-4da8-89d3-ee02d4279859 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:15.030756 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c05d07ce-090e-4da8-89d3-ee02d4279859 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:15.031243 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c05d07ce-090e-4da8-89d3-ee02d4279859 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:15.060846 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-17d8f6e1-df08-4af7-8640-e05a1f930b4d tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89" status: 200 len: 287 microversion: 2.1 time: 0.037498 Nov 19 03:24:15.061450 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 401/730] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Nov 19 03:24:15 2021] GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:15.175037 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c05d07ce-090e-4da8-89d3-ee02d4279859 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:15.184320 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c05d07ce-090e-4da8-89d3-ee02d4279859 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:15.186071 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c05d07ce-090e-4da8-89d3-ee02d4279859 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:15.187441 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c05d07ce-090e-4da8-89d3-ee02d4279859 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.170246 Nov 19 03:24:15.187992 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 330/731] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:15 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:24:15.888029 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-7eee96f4-6319-4bc3-83ea-f423d8a9071f req-723a1fe8-205e-4bc3-83fd-ab25336e6599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8641ae42-77ad-4054-8073-76018892c1d8", "name": "network-vif-plugged", "status": "completed", "tag": "4b50d896-6a79-4185-a31c-1931a0b889be"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:15.889593 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:24:15.889593 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:24:15.897176 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-7eee96f4-6319-4bc3-83ea-f423d8a9071f req-723a1fe8-205e-4bc3-83fd-ab25336e6599 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:15.897428 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-7eee96f4-6319-4bc3-83ea-f423d8a9071f req-723a1fe8-205e-4bc3-83fd-ab25336e6599 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:15.911992 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-05852da3-8ddc-4324-a8ac-f1cd55e3da8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:15.913144 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-05852da3-8ddc-4324-a8ac-f1cd55e3da8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:15.914135 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-7eee96f4-6319-4bc3-83ea-f423d8a9071f req-723a1fe8-205e-4bc3-83fd-ab25336e6599 service nova] Creating event network-vif-plugged:4b50d896-6a79-4185-a31c-1931a0b889be for instance 8641ae42-77ad-4054-8073-76018892c1d8 on hv-cinder-81803 Nov 19 03:24:15.919448 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-05852da3-8ddc-4324-a8ac-f1cd55e3da8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:15.919981 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-05852da3-8ddc-4324-a8ac-f1cd55e3da8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:15.920903 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-05852da3-8ddc-4324-a8ac-f1cd55e3da8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:15.921195 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-7eee96f4-6319-4bc3-83ea-f423d8a9071f req-723a1fe8-205e-4bc3-83fd-ab25336e6599 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037392 Nov 19 03:24:15.921515 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-05852da3-8ddc-4324-a8ac-f1cd55e3da8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:15.922999 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 402/732] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:24:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:16.021326 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-05852da3-8ddc-4324-a8ac-f1cd55e3da8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 200 len: 38312 microversion: 2.1 time: 0.112754 Nov 19 03:24:16.024132 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 331/733] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:24:15 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 38312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:24:16.033081 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-58d6aec9-924d-4e8e-8e5e-0294a297d9eb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:16.033655 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-58d6aec9-924d-4e8e-8e5e-0294a297d9eb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:16.042251 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-58d6aec9-924d-4e8e-8e5e-0294a297d9eb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:16.042729 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-58d6aec9-924d-4e8e-8e5e-0294a297d9eb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:16.043507 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-58d6aec9-924d-4e8e-8e5e-0294a297d9eb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:16.043937 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-58d6aec9-924d-4e8e-8e5e-0294a297d9eb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:16.070403 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-58d6aec9-924d-4e8e-8e5e-0294a297d9eb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/ips" status: 200 len: 145 microversion: 2.1 time: 0.042124 Nov 19 03:24:16.072852 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 403/734] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Nov 19 03:24:16 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:16.073224 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7a371619-37b0-471e-a4dd-6b6c6c221551 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a187af0>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:16.099865 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-7a371619-37b0-471e-a4dd-6b6c6c221551 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] HTTP exception thrown: Snapshot 074864f7-65b1-48f8-ad36-0f9555550f89 could not be found. Nov 19 03:24:16.100449 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7a371619-37b0-471e-a4dd-6b6c6c221551 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Returning 404 to user: Snapshot 074864f7-65b1-48f8-ad36-0f9555550f89 could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:24:16.101260 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7a371619-37b0-471e-a4dd-6b6c6c221551 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89" status: 404 len: 111 microversion: 2.1 time: 0.032241 Nov 19 03:24:16.101954 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 332/735] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Nov 19 03:24:16 2021] GET /compute/v2.1/os-snapshots/074864f7-65b1-48f8-ad36-0f9555550f89 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 03:24:16.110094 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-bffbd4fb-da73-4e69-9bb3-c9b76bfbb7e1 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a0d1160>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:16.167495 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-bffbd4fb-da73-4e69-9bb3-c9b76bfbb7e1 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c" status: 202 len: 0 microversion: 2.1 time: 0.061232 Nov 19 03:24:16.168057 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 404/736] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Nov 19 03:24:16 2021] DELETE /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:24:16.177057 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-56cd8df4-11f1-4e35-84f3-87f21ea8896f tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a1addc0>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:16.206028 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6324b6a6-e0f1-4803-a5b2-c6c03fe281c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:16.206690 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6324b6a6-e0f1-4803-a5b2-c6c03fe281c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:16.217819 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6324b6a6-e0f1-4803-a5b2-c6c03fe281c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:16.218431 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6324b6a6-e0f1-4803-a5b2-c6c03fe281c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:16.219992 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6324b6a6-e0f1-4803-a5b2-c6c03fe281c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:16.220585 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6324b6a6-e0f1-4803-a5b2-c6c03fe281c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:16.227728 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-56cd8df4-11f1-4e35-84f3-87f21ea8896f tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c" status: 200 len: 343 microversion: 2.1 time: 0.054450 Nov 19 03:24:16.228312 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 333/737] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:24:16 2021] GET /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c => generated 343 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:16.244272 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-debc2d56-4293-4a07-a800-b5d2a39478f2 tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] Calling method '.version_select at 0x7f845a187f70>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:16.292237 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-debc2d56-4293-4a07-a800-b5d2a39478f2 tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/cfa15374-79a3-453d-b802-344afd7f2541" status: 200 len: 351 microversion: 2.1 time: 0.051923 Nov 19 03:24:16.292827 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 334/738] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:24:16 2021] GET /compute/v2.1/os-volumes/cfa15374-79a3-453d-b802-344afd7f2541 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:24:16.362401 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6324b6a6-e0f1-4803-a5b2-c6c03fe281c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:16.372611 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6324b6a6-e0f1-4803-a5b2-c6c03fe281c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:16.374271 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6324b6a6-e0f1-4803-a5b2-c6c03fe281c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:16.376204 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6324b6a6-e0f1-4803-a5b2-c6c03fe281c1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.174813 Nov 19 03:24:16.376769 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 405/739] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:16 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:24:17.241048 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6f59ec73-904e-426a-b844-41aa542df11e tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a4ca430>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:17.268796 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-6f59ec73-904e-426a-b844-41aa542df11e tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] HTTP exception thrown: Volume ca5e2053-3799-4d21-9b6a-8d689f89329c could not be found. Nov 19 03:24:17.269381 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6f59ec73-904e-426a-b844-41aa542df11e tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Returning 404 to user: Volume ca5e2053-3799-4d21-9b6a-8d689f89329c could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:24:17.270198 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6f59ec73-904e-426a-b844-41aa542df11e tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c" status: 404 len: 109 microversion: 2.1 time: 0.033204 Nov 19 03:24:17.270775 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 335/740] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:24:17 2021] GET /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:24:17.285184 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-eed497a1-34ac-4739-9b9c-be447d0c2f4a tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a003790>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:17.312252 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-eed497a1-34ac-4739-9b9c-be447d0c2f4a tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] HTTP exception thrown: Volume ca5e2053-3799-4d21-9b6a-8d689f89329c could not be found. Nov 19 03:24:17.312831 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-eed497a1-34ac-4739-9b9c-be447d0c2f4a tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Returning 404 to user: Volume ca5e2053-3799-4d21-9b6a-8d689f89329c could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:24:17.313635 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-eed497a1-34ac-4739-9b9c-be447d0c2f4a tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c" status: 404 len: 109 microversion: 2.1 time: 0.033029 Nov 19 03:24:17.314551 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 406/741] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Nov 19 03:24:17 2021] DELETE /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:24:17.321770 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-51d67f7c-b235-4e07-a189-6db45b8fc5d3 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Calling method '.version_select at 0x7f845a21eee0>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:17.349831 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-51d67f7c-b235-4e07-a189-6db45b8fc5d3 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] HTTP exception thrown: Volume ca5e2053-3799-4d21-9b6a-8d689f89329c could not be found. Nov 19 03:24:17.350453 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-51d67f7c-b235-4e07-a189-6db45b8fc5d3 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] Returning 404 to user: Volume ca5e2053-3799-4d21-9b6a-8d689f89329c could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:24:17.351364 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-51d67f7c-b235-4e07-a189-6db45b8fc5d3 tempest-VolumesSnapshotsTestJSON-98522296 tempest-VolumesSnapshotsTestJSON-98522296-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c" status: 404 len: 109 microversion: 2.1 time: 0.033180 Nov 19 03:24:17.352043 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 336/742] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:24:17 2021] GET /compute/v2.1/os-volumes/ca5e2053-3799-4d21-9b6a-8d689f89329c => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:24:17.395513 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6e08d9c6-d7f4-45aa-a5a5-6efbffc63b63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:17.396069 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6e08d9c6-d7f4-45aa-a5a5-6efbffc63b63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:17.403523 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6e08d9c6-d7f4-45aa-a5a5-6efbffc63b63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:17.403975 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6e08d9c6-d7f4-45aa-a5a5-6efbffc63b63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:17.404770 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6e08d9c6-d7f4-45aa-a5a5-6efbffc63b63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:17.405208 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6e08d9c6-d7f4-45aa-a5a5-6efbffc63b63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:17.557227 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6e08d9c6-d7f4-45aa-a5a5-6efbffc63b63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:17.567149 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6e08d9c6-d7f4-45aa-a5a5-6efbffc63b63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:17.568738 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6e08d9c6-d7f4-45aa-a5a5-6efbffc63b63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:17.570003 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6e08d9c6-d7f4-45aa-a5a5-6efbffc63b63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.179440 Nov 19 03:24:17.570661 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 407/743] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:17 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:24:17.641267 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a575e569-ab03-4556-b83f-c125912c5c90 tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] Calling method '.version_select at 0x7f845b6a3ca0>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:17.688563 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a575e569-ab03-4556-b83f-c125912c5c90 tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/bc22dee4-0577-4388-b811-7607e7163f2e" status: 200 len: 351 microversion: 2.1 time: 0.052215 Nov 19 03:24:17.689215 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 337/744] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:24:17 2021] GET /compute/v2.1/os-volumes/bc22dee4-0577-4388-b811-7607e7163f2e => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:17.700021 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-83d54bce-6652-4ed6-bbcc-82c67363b3aa tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] Calling method '.version_select at 0x7f845a003040>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:17.778596 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-83d54bce-6652-4ed6-bbcc-82c67363b3aa tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.081688 Nov 19 03:24:17.779156 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 408/745] 10.222.0.47 () {58 vars in 1133 bytes} [Fri Nov 19 03:24:17 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:17.791847 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5f11fa19-e12a-455e-a6e6-20d4199ef3cb tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] Calling method '.version_select at 0x7f845a187af0>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:17.873050 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5f11fa19-e12a-455e-a6e6-20d4199ef3cb tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084768 Nov 19 03:24:17.873879 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 338/746] 10.222.0.47 () {58 vars in 1148 bytes} [Fri Nov 19 03:24:17 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:17.885235 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3ef6ad87-3aa5-4c45-a3ec-f58e5e81ba5c tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] Calling method '.version_select at 0x7f845a256ee0>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:17.970370 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3ef6ad87-3aa5-4c45-a3ec-f58e5e81ba5c tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088675 Nov 19 03:24:17.970997 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 409/747] 10.222.0.47 () {58 vars in 1133 bytes} [Fri Nov 19 03:24:17 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:17.981574 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-aa23adaf-1a1a-4637-97f2-221807228d29 tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] Calling method '.version_select at 0x7f845a356e50>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:18.072799 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-aa23adaf-1a1a-4637-97f2-221807228d29 tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094662 Nov 19 03:24:18.073487 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 339/748] 10.222.0.47 () {58 vars in 1166 bytes} [Fri Nov 19 03:24:17 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:18.085092 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-078df924-550d-4998-86a3-774816ce24f8 tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] Calling method '.version_select at 0x7f845a00a1f0>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:18.179083 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-078df924-550d-4998-86a3-774816ce24f8 tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.097464 Nov 19 03:24:18.179648 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 410/749] 10.222.0.47 () {58 vars in 1169 bytes} [Fri Nov 19 03:24:18 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:24:18.191460 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2fa3129a-d566-4e79-b1e9-37b18e911c32 tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] Calling method '.version_select at 0x7f845a1b0820>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:18.275547 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2fa3129a-d566-4e79-b1e9-37b18e911c32 tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.087969 Nov 19 03:24:18.283449 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 340/750] 10.222.0.47 () {58 vars in 1154 bytes} [Fri Nov 19 03:24:18 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:18.288977 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-28aad860-663f-4627-860d-7ad54fbed14b tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] Calling method '.version_select at 0x7f845a00adc0>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:18.383936 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-28aad860-663f-4627-860d-7ad54fbed14b tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.098476 Nov 19 03:24:18.384509 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 411/751] 10.222.0.47 () {58 vars in 1187 bytes} [Fri Nov 19 03:24:18 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:18.396482 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4b17c97c-13df-42fe-9391-c053632d5b1f tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] Calling method '.version_select at 0x7f845a1ad160>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:18.479761 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4b17c97c-13df-42fe-9391-c053632d5b1f tempest-VolumesTestJSON-364828679 tempest-VolumesTestJSON-364828679-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.086714 Nov 19 03:24:18.480580 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 341/752] 10.222.0.47 () {58 vars in 1154 bytes} [Fri Nov 19 03:24:18 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:18.579473 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5c2a531d-c3a6-4f06-a882-6cc7c1557948 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "465f7e9d-148b-4f82-827d-0afaabe469e5"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:18.588371 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5c2a531d-c3a6-4f06-a882-6cc7c1557948 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:18.593047 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b74d2b35-2574-4f6f-a090-3219c9f9524c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:18.595059 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b74d2b35-2574-4f6f-a090-3219c9f9524c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:18.597048 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5c2a531d-c3a6-4f06-a882-6cc7c1557948 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:18.597511 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5c2a531d-c3a6-4f06-a882-6cc7c1557948 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:18.598311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5c2a531d-c3a6-4f06-a882-6cc7c1557948 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:18.598780 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5c2a531d-c3a6-4f06-a882-6cc7c1557948 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:18.630326 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b74d2b35-2574-4f6f-a090-3219c9f9524c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:18.631654 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b74d2b35-2574-4f6f-a090-3219c9f9524c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:18.634302 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b74d2b35-2574-4f6f-a090-3219c9f9524c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:18.634787 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b74d2b35-2574-4f6f-a090-3219c9f9524c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:18.804229 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b74d2b35-2574-4f6f-a090-3219c9f9524c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:18.814328 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b74d2b35-2574-4f6f-a090-3219c9f9524c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:18.815967 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b74d2b35-2574-4f6f-a090-3219c9f9524c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:18.817514 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b74d2b35-2574-4f6f-a090-3219c9f9524c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1806 microversion: 2.20 time: 0.230400 Nov 19 03:24:18.818366 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 342/753] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:18 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1806 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:24:18.909117 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5c2a531d-c3a6-4f06-a882-6cc7c1557948 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333126 Nov 19 03:24:18.910653 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 412/754] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:24:18 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:24:19.835685 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4e4d516f-ebe3-4dfe-9c89-e7002829d7a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:19.836288 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4e4d516f-ebe3-4dfe-9c89-e7002829d7a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:19.842600 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e4d516f-ebe3-4dfe-9c89-e7002829d7a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:19.843046 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e4d516f-ebe3-4dfe-9c89-e7002829d7a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:19.843822 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e4d516f-ebe3-4dfe-9c89-e7002829d7a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:19.844256 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e4d516f-ebe3-4dfe-9c89-e7002829d7a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:20.223973 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-4e4d516f-ebe3-4dfe-9c89-e7002829d7a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:20.232071 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-4e4d516f-ebe3-4dfe-9c89-e7002829d7a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:20.233527 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-4e4d516f-ebe3-4dfe-9c89-e7002829d7a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:20.235357 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4e4d516f-ebe3-4dfe-9c89-e7002829d7a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1793 microversion: 2.20 time: 0.403429 Nov 19 03:24:20.235906 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 343/755] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:24:19 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1793 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:24:26.569881 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-217c7935-70f9-42e4-b02f-916f69f4bcf4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:26.579531 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-217c7935-70f9-42e4-b02f-916f69f4bcf4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:26.580017 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-217c7935-70f9-42e4-b02f-916f69f4bcf4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:26.640057 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-217c7935-70f9-42e4-b02f-916f69f4bcf4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Going to try to stop instance {{(pid=116065) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 19 03:24:26.684538 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-217c7935-70f9-42e4-b02f-916f69f4bcf4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 202 len: 0 microversion: 2.1 time: 0.118364 Nov 19 03:24:26.685113 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 413/756] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:24:26 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:24:26.693821 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-68607e60-5c1b-4b13-b8d4-935590892efc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:26.695263 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-68607e60-5c1b-4b13-b8d4-935590892efc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:26.701557 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-68607e60-5c1b-4b13-b8d4-935590892efc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:26.702167 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-68607e60-5c1b-4b13-b8d4-935590892efc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:26.703064 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-68607e60-5c1b-4b13-b8d4-935590892efc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:26.705082 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-68607e60-5c1b-4b13-b8d4-935590892efc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:26.839714 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-68607e60-5c1b-4b13-b8d4-935590892efc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:26.848485 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-68607e60-5c1b-4b13-b8d4-935590892efc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.158482 Nov 19 03:24:26.849058 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 344/757] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:26 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:27.865924 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1e485873-f094-483d-bbe6-edd57b110bdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:27.866557 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1e485873-f094-483d-bbe6-edd57b110bdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:27.872423 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1e485873-f094-483d-bbe6-edd57b110bdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:27.872864 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1e485873-f094-483d-bbe6-edd57b110bdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:27.873634 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1e485873-f094-483d-bbe6-edd57b110bdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:27.874066 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1e485873-f094-483d-bbe6-edd57b110bdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:28.008573 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1e485873-f094-483d-bbe6-edd57b110bdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:28.016980 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1e485873-f094-483d-bbe6-edd57b110bdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.155598 Nov 19 03:24:28.017678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 414/758] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:27 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:29.034536 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1d13098f-7982-4b49-b404-b256d3210061 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:29.035177 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1d13098f-7982-4b49-b404-b256d3210061 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:29.043393 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1d13098f-7982-4b49-b404-b256d3210061 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:29.043853 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1d13098f-7982-4b49-b404-b256d3210061 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:29.044646 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1d13098f-7982-4b49-b404-b256d3210061 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:29.045083 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1d13098f-7982-4b49-b404-b256d3210061 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:29.176806 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1d13098f-7982-4b49-b404-b256d3210061 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:29.184539 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1d13098f-7982-4b49-b404-b256d3210061 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.153588 Nov 19 03:24:29.185108 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 345/759] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:29 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:30.203984 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3882b13d-13b0-49ac-8da1-19de546164bf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:30.205336 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3882b13d-13b0-49ac-8da1-19de546164bf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:30.212267 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3882b13d-13b0-49ac-8da1-19de546164bf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:30.212717 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3882b13d-13b0-49ac-8da1-19de546164bf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:30.213886 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3882b13d-13b0-49ac-8da1-19de546164bf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:30.214566 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3882b13d-13b0-49ac-8da1-19de546164bf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:30.398679 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3882b13d-13b0-49ac-8da1-19de546164bf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:30.408351 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3882b13d-13b0-49ac-8da1-19de546164bf tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.207692 Nov 19 03:24:30.408939 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 415/760] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:30 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:31.426065 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-66b5cd15-6942-4ca3-885c-ea855a72f1f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:31.427811 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-66b5cd15-6942-4ca3-885c-ea855a72f1f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:31.435694 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-66b5cd15-6942-4ca3-885c-ea855a72f1f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:31.436129 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-66b5cd15-6942-4ca3-885c-ea855a72f1f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:31.436978 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-66b5cd15-6942-4ca3-885c-ea855a72f1f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:31.437489 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-66b5cd15-6942-4ca3-885c-ea855a72f1f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:31.576655 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-66b5cd15-6942-4ca3-885c-ea855a72f1f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:31.584817 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-66b5cd15-6942-4ca3-885c-ea855a72f1f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.163312 Nov 19 03:24:31.585376 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 346/761] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:31 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:32.602783 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-cc8de17c-fdad-426a-a444-f4b3a6ab35e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:32.604042 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-cc8de17c-fdad-426a-a444-f4b3a6ab35e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:32.610097 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc8de17c-fdad-426a-a444-f4b3a6ab35e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:32.611246 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc8de17c-fdad-426a-a444-f4b3a6ab35e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:32.612034 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc8de17c-fdad-426a-a444-f4b3a6ab35e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:32.612526 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc8de17c-fdad-426a-a444-f4b3a6ab35e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:32.761819 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-cc8de17c-fdad-426a-a444-f4b3a6ab35e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:32.771607 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-cc8de17c-fdad-426a-a444-f4b3a6ab35e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.172373 Nov 19 03:24:32.781802 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 416/762] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:32 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:33.788890 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1e13ebc4-b0a7-419c-b530-917385e3b45e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:33.790085 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1e13ebc4-b0a7-419c-b530-917385e3b45e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:33.796606 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1e13ebc4-b0a7-419c-b530-917385e3b45e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:33.797095 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1e13ebc4-b0a7-419c-b530-917385e3b45e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:33.798669 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1e13ebc4-b0a7-419c-b530-917385e3b45e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:33.799155 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1e13ebc4-b0a7-419c-b530-917385e3b45e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:33.937951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1e13ebc4-b0a7-419c-b530-917385e3b45e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:33.947846 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1e13ebc4-b0a7-419c-b530-917385e3b45e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.162509 Nov 19 03:24:33.948502 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 347/763] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:33 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:34.964929 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5b5977e7-4522-46ef-b9e4-31e96481989a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:34.966167 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5b5977e7-4522-46ef-b9e4-31e96481989a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:34.973464 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5b5977e7-4522-46ef-b9e4-31e96481989a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:34.973918 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5b5977e7-4522-46ef-b9e4-31e96481989a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:34.974821 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5b5977e7-4522-46ef-b9e4-31e96481989a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:34.975181 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5b5977e7-4522-46ef-b9e4-31e96481989a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:35.128488 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5b5977e7-4522-46ef-b9e4-31e96481989a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:35.136821 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5b5977e7-4522-46ef-b9e4-31e96481989a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.175554 Nov 19 03:24:35.137381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 417/764] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:34 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:36.154860 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-af444a84-6f13-4159-ac31-fe10be5719db tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:36.156050 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-af444a84-6f13-4159-ac31-fe10be5719db tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:36.164858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af444a84-6f13-4159-ac31-fe10be5719db tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:36.165429 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af444a84-6f13-4159-ac31-fe10be5719db tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:36.166598 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af444a84-6f13-4159-ac31-fe10be5719db tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:36.167541 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af444a84-6f13-4159-ac31-fe10be5719db tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:36.317699 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-af444a84-6f13-4159-ac31-fe10be5719db tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:36.325704 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-af444a84-6f13-4159-ac31-fe10be5719db tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.175006 Nov 19 03:24:36.326362 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 348/765] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:36 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:37.343239 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6991720f-6cc5-4e81-b2bd-261bccde3247 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:37.343979 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6991720f-6cc5-4e81-b2bd-261bccde3247 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:37.350831 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6991720f-6cc5-4e81-b2bd-261bccde3247 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:37.351286 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6991720f-6cc5-4e81-b2bd-261bccde3247 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:37.352076 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6991720f-6cc5-4e81-b2bd-261bccde3247 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:37.352516 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6991720f-6cc5-4e81-b2bd-261bccde3247 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:37.515469 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6991720f-6cc5-4e81-b2bd-261bccde3247 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:37.523637 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6991720f-6cc5-4e81-b2bd-261bccde3247 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.183925 Nov 19 03:24:37.524221 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 418/766] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:37 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:38.542275 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e3e0970b-eff0-4c2a-8386-0c52cce0d322 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:38.542839 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e3e0970b-eff0-4c2a-8386-0c52cce0d322 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:38.550335 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e3e0970b-eff0-4c2a-8386-0c52cce0d322 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:38.551096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e3e0970b-eff0-4c2a-8386-0c52cce0d322 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:38.552002 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e3e0970b-eff0-4c2a-8386-0c52cce0d322 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:38.552443 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e3e0970b-eff0-4c2a-8386-0c52cce0d322 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:38.694630 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e3e0970b-eff0-4c2a-8386-0c52cce0d322 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:38.703697 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e3e0970b-eff0-4c2a-8386-0c52cce0d322 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.165323 Nov 19 03:24:38.704475 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 349/767] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:38 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:24:39.722123 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-399a4e5e-a0f4-43ec-be07-05fef93ad492 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:39.722761 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-399a4e5e-a0f4-43ec-be07-05fef93ad492 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:39.729015 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-399a4e5e-a0f4-43ec-be07-05fef93ad492 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:39.729465 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-399a4e5e-a0f4-43ec-be07-05fef93ad492 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:39.730243 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-399a4e5e-a0f4-43ec-be07-05fef93ad492 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:39.730709 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-399a4e5e-a0f4-43ec-be07-05fef93ad492 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:39.863573 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-399a4e5e-a0f4-43ec-be07-05fef93ad492 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:39.871308 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-399a4e5e-a0f4-43ec-be07-05fef93ad492 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.153611 Nov 19 03:24:39.871876 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 419/768] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:39 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:40.888860 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-58634f07-013c-402b-ab30-b6afd6348613 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:40.889498 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-58634f07-013c-402b-ab30-b6afd6348613 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:40.896503 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-58634f07-013c-402b-ab30-b6afd6348613 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:40.896957 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-58634f07-013c-402b-ab30-b6afd6348613 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:40.897733 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-58634f07-013c-402b-ab30-b6afd6348613 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:40.898170 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-58634f07-013c-402b-ab30-b6afd6348613 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:41.027880 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-58634f07-013c-402b-ab30-b6afd6348613 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:41.036705 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-58634f07-013c-402b-ab30-b6afd6348613 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.151425 Nov 19 03:24:41.037194 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 350/769] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:40 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:42.053612 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4fa2e0e0-4229-4a8f-b01e-14e50eb7d749 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:42.054166 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4fa2e0e0-4229-4a8f-b01e-14e50eb7d749 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:42.060667 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4fa2e0e0-4229-4a8f-b01e-14e50eb7d749 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:42.061116 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4fa2e0e0-4229-4a8f-b01e-14e50eb7d749 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:42.061904 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4fa2e0e0-4229-4a8f-b01e-14e50eb7d749 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:42.062339 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4fa2e0e0-4229-4a8f-b01e-14e50eb7d749 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:42.192577 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4fa2e0e0-4229-4a8f-b01e-14e50eb7d749 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:42.200218 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4fa2e0e0-4229-4a8f-b01e-14e50eb7d749 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.150286 Nov 19 03:24:42.200784 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 420/770] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:42 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:43.216892 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5e79fd4a-9d57-48b1-862f-5f235fe6262f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:43.217497 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5e79fd4a-9d57-48b1-862f-5f235fe6262f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:43.223885 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5e79fd4a-9d57-48b1-862f-5f235fe6262f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:43.224335 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5e79fd4a-9d57-48b1-862f-5f235fe6262f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:43.225112 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5e79fd4a-9d57-48b1-862f-5f235fe6262f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:43.225549 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5e79fd4a-9d57-48b1-862f-5f235fe6262f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:43.354571 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5e79fd4a-9d57-48b1-862f-5f235fe6262f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:43.362799 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5e79fd4a-9d57-48b1-862f-5f235fe6262f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.149427 Nov 19 03:24:43.363367 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 351/771] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:43 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:44.380419 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-375a051b-c923-4888-9e00-02eb1c5d0284 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:44.381031 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-375a051b-c923-4888-9e00-02eb1c5d0284 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:44.387275 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-375a051b-c923-4888-9e00-02eb1c5d0284 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:44.387724 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-375a051b-c923-4888-9e00-02eb1c5d0284 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:44.388497 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-375a051b-c923-4888-9e00-02eb1c5d0284 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:44.388930 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-375a051b-c923-4888-9e00-02eb1c5d0284 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:44.517403 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-375a051b-c923-4888-9e00-02eb1c5d0284 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:44.525205 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-375a051b-c923-4888-9e00-02eb1c5d0284 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.149226 Nov 19 03:24:44.525782 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 421/772] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:44 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:45.542807 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ce95ee51-067f-4702-8804-6b0c43673965 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:45.543406 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ce95ee51-067f-4702-8804-6b0c43673965 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:45.550076 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ce95ee51-067f-4702-8804-6b0c43673965 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:45.550545 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ce95ee51-067f-4702-8804-6b0c43673965 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:45.551317 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ce95ee51-067f-4702-8804-6b0c43673965 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:45.551748 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ce95ee51-067f-4702-8804-6b0c43673965 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:45.683392 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ce95ee51-067f-4702-8804-6b0c43673965 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:45.691462 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ce95ee51-067f-4702-8804-6b0c43673965 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.152253 Nov 19 03:24:45.692033 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 352/773] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:45 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:46.709808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-749057fc-e2f5-4823-8561-b3c1a4413bb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:46.710415 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-749057fc-e2f5-4823-8561-b3c1a4413bb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:46.716671 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-749057fc-e2f5-4823-8561-b3c1a4413bb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:46.717121 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-749057fc-e2f5-4823-8561-b3c1a4413bb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:46.717895 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-749057fc-e2f5-4823-8561-b3c1a4413bb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:46.718326 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-749057fc-e2f5-4823-8561-b3c1a4413bb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:46.869425 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-749057fc-e2f5-4823-8561-b3c1a4413bb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:46.877668 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-749057fc-e2f5-4823-8561-b3c1a4413bb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1723 microversion: 2.1 time: 0.172013 Nov 19 03:24:46.878240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 422/774] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:46 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:47.417760 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-96d035dd-8d50-4edd-84ef-2c947db4f3f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:47.418949 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-96d035dd-8d50-4edd-84ef-2c947db4f3f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:47.425982 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-96d035dd-8d50-4edd-84ef-2c947db4f3f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:47.427234 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-96d035dd-8d50-4edd-84ef-2c947db4f3f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:47.428110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-96d035dd-8d50-4edd-84ef-2c947db4f3f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:47.428611 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-96d035dd-8d50-4edd-84ef-2c947db4f3f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:47.508743 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-96d035dd-8d50-4edd-84ef-2c947db4f3f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "POST /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/action" status: 202 len: 0 microversion: 2.1 time: 0.094901 Nov 19 03:24:47.509616 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 353/775] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:24:47 2021] POST /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:24:47.519413 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-961764f5-666d-48ec-832d-678f72135158 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:47.520327 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-961764f5-666d-48ec-832d-678f72135158 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:47.526835 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-961764f5-666d-48ec-832d-678f72135158 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:47.527356 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-961764f5-666d-48ec-832d-678f72135158 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:47.528327 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-961764f5-666d-48ec-832d-678f72135158 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:47.528777 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-961764f5-666d-48ec-832d-678f72135158 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:47.761116 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-961764f5-666d-48ec-832d-678f72135158 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:47.773527 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-961764f5-666d-48ec-832d-678f72135158 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1753 microversion: 2.1 time: 0.259312 Nov 19 03:24:47.774129 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 423/776] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:47 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1753 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:47.896974 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a33f1753-f1ea-4ae0-8ff1-982f59c56a3f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:47.897669 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a33f1753-f1ea-4ae0-8ff1-982f59c56a3f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:47.904026 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a33f1753-f1ea-4ae0-8ff1-982f59c56a3f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:47.904729 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a33f1753-f1ea-4ae0-8ff1-982f59c56a3f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:47.905501 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a33f1753-f1ea-4ae0-8ff1-982f59c56a3f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:47.905925 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a33f1753-f1ea-4ae0-8ff1-982f59c56a3f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:48.141146 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a33f1753-f1ea-4ae0-8ff1-982f59c56a3f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:48.149232 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a33f1753-f1ea-4ae0-8ff1-982f59c56a3f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1700 microversion: 2.1 time: 0.257583 Nov 19 03:24:48.162921 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 354/777] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:47 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1700 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:48.167547 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6ea8a989-6a14-4dca-bf23-d8e3244f0a51 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:48.174599 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6ea8a989-6a14-4dca-bf23-d8e3244f0a51 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:48.175329 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6ea8a989-6a14-4dca-bf23-d8e3244f0a51 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:48.200002 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6ea8a989-6a14-4dca-bf23-d8e3244f0a51 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Going to try to start instance {{(pid=116065) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 19 03:24:48.244448 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6ea8a989-6a14-4dca-bf23-d8e3244f0a51 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 202 len: 0 microversion: 2.1 time: 0.081165 Nov 19 03:24:48.245319 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 424/778] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:24:48 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:24:48.261461 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-54cb955b-3204-47bc-89a4-cf34e2d496fb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:48.262413 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-54cb955b-3204-47bc-89a4-cf34e2d496fb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:48.271248 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-54cb955b-3204-47bc-89a4-cf34e2d496fb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:48.271688 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-54cb955b-3204-47bc-89a4-cf34e2d496fb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:48.272559 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-54cb955b-3204-47bc-89a4-cf34e2d496fb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:48.272991 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-54cb955b-3204-47bc-89a4-cf34e2d496fb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:48.469588 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-54cb955b-3204-47bc-89a4-cf34e2d496fb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:48.479483 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-54cb955b-3204-47bc-89a4-cf34e2d496fb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1709 microversion: 2.1 time: 0.223826 Nov 19 03:24:48.480481 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 355/779] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:48 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1709 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:24:48.792597 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5288fe46-6b7f-4ba7-978f-166ab8d9dee4 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:48.793957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5288fe46-6b7f-4ba7-978f-166ab8d9dee4 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:48.801491 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5288fe46-6b7f-4ba7-978f-166ab8d9dee4 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:48.802163 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5288fe46-6b7f-4ba7-978f-166ab8d9dee4 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:48.803666 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5288fe46-6b7f-4ba7-978f-166ab8d9dee4 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:48.804269 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5288fe46-6b7f-4ba7-978f-166ab8d9dee4 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:49.122500 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5288fe46-6b7f-4ba7-978f-166ab8d9dee4 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:49.137058 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5288fe46-6b7f-4ba7-978f-166ab8d9dee4 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.348361 Nov 19 03:24:49.138117 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 425/780] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:48 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:49.496915 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ed18b9ef-eb9e-4ede-9416-28f5a09b97c1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:49.497516 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ed18b9ef-eb9e-4ede-9416-28f5a09b97c1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:49.511859 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed18b9ef-eb9e-4ede-9416-28f5a09b97c1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:49.512307 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed18b9ef-eb9e-4ede-9416-28f5a09b97c1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:49.513096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed18b9ef-eb9e-4ede-9416-28f5a09b97c1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:49.513525 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed18b9ef-eb9e-4ede-9416-28f5a09b97c1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:49.714406 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ed18b9ef-eb9e-4ede-9416-28f5a09b97c1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:49.725443 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ed18b9ef-eb9e-4ede-9416-28f5a09b97c1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1709 microversion: 2.1 time: 0.231823 Nov 19 03:24:49.726243 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 356/781] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:49 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1709 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:50.155396 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8a1052aa-555f-4877-a524-e6b20c2f011b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:50.156015 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8a1052aa-555f-4877-a524-e6b20c2f011b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:50.163528 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8a1052aa-555f-4877-a524-e6b20c2f011b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:50.163978 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8a1052aa-555f-4877-a524-e6b20c2f011b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:50.164948 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8a1052aa-555f-4877-a524-e6b20c2f011b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:50.165388 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8a1052aa-555f-4877-a524-e6b20c2f011b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:50.333942 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8a1052aa-555f-4877-a524-e6b20c2f011b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:50.349115 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8a1052aa-555f-4877-a524-e6b20c2f011b tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.197173 Nov 19 03:24:50.358354 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 426/782] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:50 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:50.744113 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b27d64c7-1b64-45b0-ab59-c0361f3c70b5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:50.744712 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b27d64c7-1b64-45b0-ab59-c0361f3c70b5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:50.750827 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b27d64c7-1b64-45b0-ab59-c0361f3c70b5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:50.751324 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b27d64c7-1b64-45b0-ab59-c0361f3c70b5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:50.752146 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b27d64c7-1b64-45b0-ab59-c0361f3c70b5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:50.752569 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b27d64c7-1b64-45b0-ab59-c0361f3c70b5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:50.884641 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b27d64c7-1b64-45b0-ab59-c0361f3c70b5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:50.893087 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b27d64c7-1b64-45b0-ab59-c0361f3c70b5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1713 microversion: 2.1 time: 0.152582 Nov 19 03:24:50.893658 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 357/783] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:50 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1713 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:51.365640 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-44a205df-c3a7-47d1-86d3-ae5c0f8d56e3 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:51.366237 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-44a205df-c3a7-47d1-86d3-ae5c0f8d56e3 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:51.372541 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-44a205df-c3a7-47d1-86d3-ae5c0f8d56e3 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:51.373004 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-44a205df-c3a7-47d1-86d3-ae5c0f8d56e3 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:51.373760 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-44a205df-c3a7-47d1-86d3-ae5c0f8d56e3 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:51.374187 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-44a205df-c3a7-47d1-86d3-ae5c0f8d56e3 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:51.522460 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-44a205df-c3a7-47d1-86d3-ae5c0f8d56e3 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:51.531876 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-44a205df-c3a7-47d1-86d3-ae5c0f8d56e3 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.169785 Nov 19 03:24:51.541582 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 427/784] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:51 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:51.541785 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1346832260", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "networks": [{"uuid": "2294e149-4611-4500-8734-b9b290b7e149"}]}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:51.590029 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.network.neutron [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] validate_networks() for [('2294e149-4611-4500-8734-b9b290b7e149', None, None, None, None, None)] {{(pid=116066) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:24:51.945089 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Flavor limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:24:51.945694 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Image limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:24:51.945951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Flavor pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:24:51.946351 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Image pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:24:51.946775 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:24:51.956438 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:51.956875 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:51.957668 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:51.958094 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:51.973978 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Getting quotas for project 1c75c732daa4453ebbc81731ee7c28c3. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:24:51.978078 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Getting quotas for user 9e981b2dbe91448c88738ef2c13a083b and project 1c75c732daa4453ebbc81731ee7c28c3. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:24:51.989181 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Going to run 1 instances... {{(pid=116066) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:24:51.991521 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:24:52.037269 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ddc9fa21-2179-4e21-81dd-28412a66f788 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506442 Nov 19 03:24:52.037910 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 358/785] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:24:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 03:24:52.047590 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3f33b2c8-090a-427b-9fbf-fa80c1466aa2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:52.048299 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3f33b2c8-090a-427b-9fbf-fa80c1466aa2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:52.102593 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3f33b2c8-090a-427b-9fbf-fa80c1466aa2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:52.109542 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3f33b2c8-090a-427b-9fbf-fa80c1466aa2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1214 microversion: 2.1 time: 0.065518 Nov 19 03:24:52.110150 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 428/786] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:52 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:52.549018 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1df9b55f-8a46-4ccb-92c4-0899066183f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:52.549614 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1df9b55f-8a46-4ccb-92c4-0899066183f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:52.556294 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1df9b55f-8a46-4ccb-92c4-0899066183f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:52.556916 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1df9b55f-8a46-4ccb-92c4-0899066183f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:52.557701 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1df9b55f-8a46-4ccb-92c4-0899066183f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:52.558133 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1df9b55f-8a46-4ccb-92c4-0899066183f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:52.713578 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1df9b55f-8a46-4ccb-92c4-0899066183f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:52.723857 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1df9b55f-8a46-4ccb-92c4-0899066183f2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.178489 Nov 19 03:24:52.724424 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 359/787] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:52 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:53.129502 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a070487a-9404-433d-bed8-54ba40631a9c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:53.130107 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a070487a-9404-433d-bed8-54ba40631a9c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:53.136501 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a070487a-9404-433d-bed8-54ba40631a9c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:53.136942 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a070487a-9404-433d-bed8-54ba40631a9c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:53.137706 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a070487a-9404-433d-bed8-54ba40631a9c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:53.138133 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a070487a-9404-433d-bed8-54ba40631a9c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:53.197902 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a070487a-9404-433d-bed8-54ba40631a9c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:53.205638 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a070487a-9404-433d-bed8-54ba40631a9c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1210 microversion: 2.1 time: 0.080067 Nov 19 03:24:53.206194 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 429/788] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:53 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:53.741301 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-013ec763-936a-4520-9f3d-46a5e2541740 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:53.741907 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-013ec763-936a-4520-9f3d-46a5e2541740 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:53.748225 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-013ec763-936a-4520-9f3d-46a5e2541740 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:53.748670 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-013ec763-936a-4520-9f3d-46a5e2541740 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:53.749432 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-013ec763-936a-4520-9f3d-46a5e2541740 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:53.749863 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-013ec763-936a-4520-9f3d-46a5e2541740 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:53.895146 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-013ec763-936a-4520-9f3d-46a5e2541740 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:53.902777 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-013ec763-936a-4520-9f3d-46a5e2541740 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.165033 Nov 19 03:24:53.903332 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 360/789] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:53 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:54.221712 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c8b23c36-295c-4d8b-bcf6-a84aae7c9eee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:54.222646 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c8b23c36-295c-4d8b-bcf6-a84aae7c9eee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:54.229901 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c8b23c36-295c-4d8b-bcf6-a84aae7c9eee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:54.230345 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c8b23c36-295c-4d8b-bcf6-a84aae7c9eee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:54.231148 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c8b23c36-295c-4d8b-bcf6-a84aae7c9eee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:54.231577 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c8b23c36-295c-4d8b-bcf6-a84aae7c9eee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:54.294221 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c8b23c36-295c-4d8b-bcf6-a84aae7c9eee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:54.302044 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c8b23c36-295c-4d8b-bcf6-a84aae7c9eee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1210 microversion: 2.1 time: 0.083891 Nov 19 03:24:54.302664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 430/790] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:54 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:54.920036 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0683700e-3c86-4ff0-8d31-68353d99e558 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:54.920630 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0683700e-3c86-4ff0-8d31-68353d99e558 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:54.927582 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0683700e-3c86-4ff0-8d31-68353d99e558 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:54.928021 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0683700e-3c86-4ff0-8d31-68353d99e558 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:54.928782 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0683700e-3c86-4ff0-8d31-68353d99e558 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:54.929209 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0683700e-3c86-4ff0-8d31-68353d99e558 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:55.255158 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0683700e-3c86-4ff0-8d31-68353d99e558 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:55.262909 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0683700e-3c86-4ff0-8d31-68353d99e558 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.346404 Nov 19 03:24:55.263479 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 361/791] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:54 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:55.318574 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-774b37ff-9cb7-455a-92b3-20bc09b3360c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:55.319179 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-774b37ff-9cb7-455a-92b3-20bc09b3360c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:55.325442 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-774b37ff-9cb7-455a-92b3-20bc09b3360c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:55.325904 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-774b37ff-9cb7-455a-92b3-20bc09b3360c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:55.326679 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-774b37ff-9cb7-455a-92b3-20bc09b3360c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:55.327105 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-774b37ff-9cb7-455a-92b3-20bc09b3360c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:55.435728 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-774b37ff-9cb7-455a-92b3-20bc09b3360c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:55.443848 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-774b37ff-9cb7-455a-92b3-20bc09b3360c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1210 microversion: 2.1 time: 0.128647 Nov 19 03:24:55.444680 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 431/792] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:55 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1210 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:56.281158 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a380b2a7-773e-41e5-a07b-a10fe79f05aa tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:56.281792 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a380b2a7-773e-41e5-a07b-a10fe79f05aa tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:56.288789 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a380b2a7-773e-41e5-a07b-a10fe79f05aa tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:56.289500 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a380b2a7-773e-41e5-a07b-a10fe79f05aa tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:56.290284 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a380b2a7-773e-41e5-a07b-a10fe79f05aa tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:56.290740 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a380b2a7-773e-41e5-a07b-a10fe79f05aa tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:56.460457 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a966cc0c-e157-48b3-bbef-c6bca23199ee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:56.461087 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a966cc0c-e157-48b3-bbef-c6bca23199ee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:56.469474 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a966cc0c-e157-48b3-bbef-c6bca23199ee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:56.470596 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a966cc0c-e157-48b3-bbef-c6bca23199ee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:56.472071 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a966cc0c-e157-48b3-bbef-c6bca23199ee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:56.472662 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a966cc0c-e157-48b3-bbef-c6bca23199ee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:56.559157 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a966cc0c-e157-48b3-bbef-c6bca23199ee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:56.566590 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a966cc0c-e157-48b3-bbef-c6bca23199ee tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1272 microversion: 2.1 time: 0.109608 Nov 19 03:24:56.567171 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 432/793] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:56 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1272 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:24:56.578949 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a380b2a7-773e-41e5-a07b-a10fe79f05aa tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:56.588429 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a380b2a7-773e-41e5-a07b-a10fe79f05aa tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.311003 Nov 19 03:24:56.589467 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 362/794] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:56 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:57.583625 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-190f2b1d-4ce2-4dc7-be66-b2ac7bccb4c1 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:57.584261 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-190f2b1d-4ce2-4dc7-be66-b2ac7bccb4c1 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:57.590725 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-190f2b1d-4ce2-4dc7-be66-b2ac7bccb4c1 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:57.591172 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-190f2b1d-4ce2-4dc7-be66-b2ac7bccb4c1 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:57.591950 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-190f2b1d-4ce2-4dc7-be66-b2ac7bccb4c1 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:57.592381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-190f2b1d-4ce2-4dc7-be66-b2ac7bccb4c1 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:57.606371 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d7e92357-6047-4eeb-ae0a-46ee391d349d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:57.607019 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d7e92357-6047-4eeb-ae0a-46ee391d349d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:57.614086 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7e92357-6047-4eeb-ae0a-46ee391d349d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:57.614574 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7e92357-6047-4eeb-ae0a-46ee391d349d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:57.615637 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7e92357-6047-4eeb-ae0a-46ee391d349d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:57.616244 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7e92357-6047-4eeb-ae0a-46ee391d349d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:57.913309 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-190f2b1d-4ce2-4dc7-be66-b2ac7bccb4c1 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:57.920783 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-190f2b1d-4ce2-4dc7-be66-b2ac7bccb4c1 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.340819 Nov 19 03:24:57.921459 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 433/795] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:57 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:57.953450 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d7e92357-6047-4eeb-ae0a-46ee391d349d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:57.961866 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d7e92357-6047-4eeb-ae0a-46ee391d349d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.359571 Nov 19 03:24:57.962444 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 363/796] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:57 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:24:58.095442 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-328dd94c-bad4-430a-b747-78e8152abf59 req-b920a1b8-1992-404d-bb20-dff897c2177e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e24f94eb-65e4-4d85-9117-de9e6c26c0e8", "tag": "24528e7f-8831-4104-bcd0-4a6a28f9fb12"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:24:58.097010 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:24:58.097010 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:24:58.103766 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-328dd94c-bad4-430a-b747-78e8152abf59 req-b920a1b8-1992-404d-bb20-dff897c2177e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:58.104199 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-328dd94c-bad4-430a-b747-78e8152abf59 req-b920a1b8-1992-404d-bb20-dff897c2177e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:58.116080 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-328dd94c-bad4-430a-b747-78e8152abf59 req-b920a1b8-1992-404d-bb20-dff897c2177e service nova] Creating event network-changed:24528e7f-8831-4104-bcd0-4a6a28f9fb12 for instance e24f94eb-65e4-4d85-9117-de9e6c26c0e8 on hv-cinder-81803 Nov 19 03:24:58.120977 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-328dd94c-bad4-430a-b747-78e8152abf59 req-b920a1b8-1992-404d-bb20-dff897c2177e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029211 Nov 19 03:24:58.121569 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 434/797] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:24:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:24:58.239103 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:24:58.239297 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: Fri Nov 19 03:24:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:24:58.937749 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0bf76af9-15d5-4715-940b-e3772613b9c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:58.938348 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0bf76af9-15d5-4715-940b-e3772613b9c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:58.945026 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0bf76af9-15d5-4715-940b-e3772613b9c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:58.945470 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0bf76af9-15d5-4715-940b-e3772613b9c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:58.946247 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0bf76af9-15d5-4715-940b-e3772613b9c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:58.946712 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0bf76af9-15d5-4715-940b-e3772613b9c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:58.978712 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1c142ea2-d7c4-4c7f-9690-b8e11e2e3c12 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:24:58.979519 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1c142ea2-d7c4-4c7f-9690-b8e11e2e3c12 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:24:58.986793 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c142ea2-d7c4-4c7f-9690-b8e11e2e3c12 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:58.987333 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c142ea2-d7c4-4c7f-9690-b8e11e2e3c12 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:58.988198 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c142ea2-d7c4-4c7f-9690-b8e11e2e3c12 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:24:58.988645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1c142ea2-d7c4-4c7f-9690-b8e11e2e3c12 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:24:59.116966 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0bf76af9-15d5-4715-940b-e3772613b9c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:59.124866 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0bf76af9-15d5-4715-940b-e3772613b9c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.190739 Nov 19 03:24:59.125634 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 364/798] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:58 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:24:59.182108 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1c142ea2-d7c4-4c7f-9690-b8e11e2e3c12 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:24:59.190385 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1c142ea2-d7c4-4c7f-9690-b8e11e2e3c12 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.215518 Nov 19 03:24:59.190908 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 435/799] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:24:58 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:00.142734 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5a80872f-b16e-4320-95c7-bb85ad2f0232 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:00.143394 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5a80872f-b16e-4320-95c7-bb85ad2f0232 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:00.149562 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5a80872f-b16e-4320-95c7-bb85ad2f0232 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:00.150001 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5a80872f-b16e-4320-95c7-bb85ad2f0232 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:00.150792 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5a80872f-b16e-4320-95c7-bb85ad2f0232 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:00.151217 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5a80872f-b16e-4320-95c7-bb85ad2f0232 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:00.207044 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-860d17c3-ae1e-4abf-b024-95e7ad158a74 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:00.207653 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-860d17c3-ae1e-4abf-b024-95e7ad158a74 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:00.213888 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-860d17c3-ae1e-4abf-b024-95e7ad158a74 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:00.214329 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-860d17c3-ae1e-4abf-b024-95e7ad158a74 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:00.215196 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-860d17c3-ae1e-4abf-b024-95e7ad158a74 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:00.215582 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-860d17c3-ae1e-4abf-b024-95e7ad158a74 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:00.316481 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5a80872f-b16e-4320-95c7-bb85ad2f0232 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:00.333778 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5a80872f-b16e-4320-95c7-bb85ad2f0232 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.194750 Nov 19 03:25:00.334512 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 365/800] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:00 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:00.399428 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-860d17c3-ae1e-4abf-b024-95e7ad158a74 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:00.407277 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-860d17c3-ae1e-4abf-b024-95e7ad158a74 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.204546 Nov 19 03:25:00.407960 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 436/801] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:00 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:01.351267 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-78869f70-09ff-422e-b926-b6f1c5fa5fc6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:01.351871 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-78869f70-09ff-422e-b926-b6f1c5fa5fc6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:01.360087 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-78869f70-09ff-422e-b926-b6f1c5fa5fc6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:01.360087 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-78869f70-09ff-422e-b926-b6f1c5fa5fc6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:01.360947 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-78869f70-09ff-422e-b926-b6f1c5fa5fc6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:01.361458 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-78869f70-09ff-422e-b926-b6f1c5fa5fc6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:01.424309 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6adee5e5-7381-4adc-9b44-d078dc107e14 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:01.424934 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6adee5e5-7381-4adc-9b44-d078dc107e14 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:01.431555 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6adee5e5-7381-4adc-9b44-d078dc107e14 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:01.431997 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6adee5e5-7381-4adc-9b44-d078dc107e14 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:01.432785 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6adee5e5-7381-4adc-9b44-d078dc107e14 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:01.433218 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6adee5e5-7381-4adc-9b44-d078dc107e14 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:01.700136 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-78869f70-09ff-422e-b926-b6f1c5fa5fc6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:01.708290 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-78869f70-09ff-422e-b926-b6f1c5fa5fc6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.360648 Nov 19 03:25:01.708871 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 366/802] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:01 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:01.746522 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6adee5e5-7381-4adc-9b44-d078dc107e14 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:01.755383 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6adee5e5-7381-4adc-9b44-d078dc107e14 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.334777 Nov 19 03:25:01.755969 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 437/803] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:01 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:02.725508 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d8b7e5e5-922b-42a0-ac2f-80e048df9689 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:02.726135 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d8b7e5e5-922b-42a0-ac2f-80e048df9689 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:02.732387 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d8b7e5e5-922b-42a0-ac2f-80e048df9689 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:02.732822 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d8b7e5e5-922b-42a0-ac2f-80e048df9689 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:02.733586 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d8b7e5e5-922b-42a0-ac2f-80e048df9689 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:02.734007 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d8b7e5e5-922b-42a0-ac2f-80e048df9689 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:02.772795 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1094d062-16db-44a8-bddb-806f3736879e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:02.773399 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1094d062-16db-44a8-bddb-806f3736879e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:02.779985 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1094d062-16db-44a8-bddb-806f3736879e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:02.780463 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1094d062-16db-44a8-bddb-806f3736879e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:02.781241 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1094d062-16db-44a8-bddb-806f3736879e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:02.781667 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1094d062-16db-44a8-bddb-806f3736879e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:02.905744 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d8b7e5e5-922b-42a0-ac2f-80e048df9689 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:02.922553 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d8b7e5e5-922b-42a0-ac2f-80e048df9689 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.200543 Nov 19 03:25:02.923184 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 367/804] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:02 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:02.964481 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1094d062-16db-44a8-bddb-806f3736879e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:02.972798 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1094d062-16db-44a8-bddb-806f3736879e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.203515 Nov 19 03:25:02.973360 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 438/805] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:02 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:03.939041 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a9a9dd32-a463-40de-9117-f3eebf7b3655 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:03.939664 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a9a9dd32-a463-40de-9117-f3eebf7b3655 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:03.946032 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a9a9dd32-a463-40de-9117-f3eebf7b3655 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:03.946502 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a9a9dd32-a463-40de-9117-f3eebf7b3655 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:03.947281 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a9a9dd32-a463-40de-9117-f3eebf7b3655 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:03.947710 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a9a9dd32-a463-40de-9117-f3eebf7b3655 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:03.989648 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-30a35e97-fbf2-49cc-a2cb-36ebaba21627 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:03.990365 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-30a35e97-fbf2-49cc-a2cb-36ebaba21627 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:03.996781 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-30a35e97-fbf2-49cc-a2cb-36ebaba21627 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:03.997239 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-30a35e97-fbf2-49cc-a2cb-36ebaba21627 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:03.998026 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-30a35e97-fbf2-49cc-a2cb-36ebaba21627 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:03.998461 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-30a35e97-fbf2-49cc-a2cb-36ebaba21627 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:04.119114 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a9a9dd32-a463-40de-9117-f3eebf7b3655 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:04.126455 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a9a9dd32-a463-40de-9117-f3eebf7b3655 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.191063 Nov 19 03:25:04.127130 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 368/806] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:03 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:04.174562 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-30a35e97-fbf2-49cc-a2cb-36ebaba21627 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:04.182347 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-30a35e97-fbf2-49cc-a2cb-36ebaba21627 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.197181 Nov 19 03:25:04.182949 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 439/807] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:03 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:05.143242 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-fca3958d-b6de-44c5-b3ec-de6b4b3f81c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:05.143866 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-fca3958d-b6de-44c5-b3ec-de6b4b3f81c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:05.149797 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fca3958d-b6de-44c5-b3ec-de6b4b3f81c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:05.150239 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fca3958d-b6de-44c5-b3ec-de6b4b3f81c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:05.151026 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fca3958d-b6de-44c5-b3ec-de6b4b3f81c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:05.151448 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fca3958d-b6de-44c5-b3ec-de6b4b3f81c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:05.199582 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f133a767-fb9c-440a-bf53-1a1b402d23eb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:05.200221 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f133a767-fb9c-440a-bf53-1a1b402d23eb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:05.206691 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f133a767-fb9c-440a-bf53-1a1b402d23eb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:05.207135 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f133a767-fb9c-440a-bf53-1a1b402d23eb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:05.207932 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f133a767-fb9c-440a-bf53-1a1b402d23eb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:05.208361 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f133a767-fb9c-440a-bf53-1a1b402d23eb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:05.313027 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-fca3958d-b6de-44c5-b3ec-de6b4b3f81c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:05.320505 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-fca3958d-b6de-44c5-b3ec-de6b4b3f81c6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.180866 Nov 19 03:25:05.320936 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 369/808] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:05 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:05.383722 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f133a767-fb9c-440a-bf53-1a1b402d23eb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:05.391376 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f133a767-fb9c-440a-bf53-1a1b402d23eb tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.195425 Nov 19 03:25:05.392034 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 440/809] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:05 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:05.985851 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:25:05.986032 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: Fri Nov 19 03:25:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:25:06.336793 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c2c850b0-17f5-4942-b3b1-9d25b5ce2d1e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:06.337436 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c2c850b0-17f5-4942-b3b1-9d25b5ce2d1e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:06.343996 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c2c850b0-17f5-4942-b3b1-9d25b5ce2d1e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:06.344445 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c2c850b0-17f5-4942-b3b1-9d25b5ce2d1e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:06.345398 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c2c850b0-17f5-4942-b3b1-9d25b5ce2d1e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:06.345840 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c2c850b0-17f5-4942-b3b1-9d25b5ce2d1e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:06.408589 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-42494708-c7ba-493d-a7c9-b54e6dea54c7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:06.409200 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-42494708-c7ba-493d-a7c9-b54e6dea54c7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:06.415115 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-42494708-c7ba-493d-a7c9-b54e6dea54c7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:06.415559 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-42494708-c7ba-493d-a7c9-b54e6dea54c7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:06.416337 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-42494708-c7ba-493d-a7c9-b54e6dea54c7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:06.416772 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-42494708-c7ba-493d-a7c9-b54e6dea54c7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:06.508060 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c2c850b0-17f5-4942-b3b1-9d25b5ce2d1e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:06.515362 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c2c850b0-17f5-4942-b3b1-9d25b5ce2d1e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.182222 Nov 19 03:25:06.515921 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 370/810] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:06 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:06.585529 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-42494708-c7ba-493d-a7c9-b54e6dea54c7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:06.596705 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-42494708-c7ba-493d-a7c9-b54e6dea54c7 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.191939 Nov 19 03:25:06.597214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 441/811] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:06 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:07.533108 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f77e35f3-157b-4ba9-9f01-635f807b5956 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:07.533876 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f77e35f3-157b-4ba9-9f01-635f807b5956 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:07.540470 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f77e35f3-157b-4ba9-9f01-635f807b5956 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:07.540917 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f77e35f3-157b-4ba9-9f01-635f807b5956 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:07.541692 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f77e35f3-157b-4ba9-9f01-635f807b5956 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:07.542127 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f77e35f3-157b-4ba9-9f01-635f807b5956 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:07.613354 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d954aa6f-e6ad-4dea-8d89-81883bec564c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:07.614059 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d954aa6f-e6ad-4dea-8d89-81883bec564c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:07.621041 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d954aa6f-e6ad-4dea-8d89-81883bec564c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:07.621402 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d954aa6f-e6ad-4dea-8d89-81883bec564c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:07.622656 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d954aa6f-e6ad-4dea-8d89-81883bec564c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:07.622656 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d954aa6f-e6ad-4dea-8d89-81883bec564c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:07.702830 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-f77e35f3-157b-4ba9-9f01-635f807b5956 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:07.710532 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f77e35f3-157b-4ba9-9f01-635f807b5956 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.182096 Nov 19 03:25:07.711306 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 371/812] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:07 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:07.794275 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d954aa6f-e6ad-4dea-8d89-81883bec564c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:07.803471 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d954aa6f-e6ad-4dea-8d89-81883bec564c tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.193723 Nov 19 03:25:07.804404 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 442/813] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:07 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:08.727191 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-bb780dd5-6f70-4e9c-9c28-6dbe15d6a103 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:08.727794 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-bb780dd5-6f70-4e9c-9c28-6dbe15d6a103 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:08.734140 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bb780dd5-6f70-4e9c-9c28-6dbe15d6a103 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:08.734630 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bb780dd5-6f70-4e9c-9c28-6dbe15d6a103 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:08.735409 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bb780dd5-6f70-4e9c-9c28-6dbe15d6a103 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:08.735894 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bb780dd5-6f70-4e9c-9c28-6dbe15d6a103 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:08.820735 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d5ef24c4-1169-4de5-ac08-8827abb6e115 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:08.821418 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d5ef24c4-1169-4de5-ac08-8827abb6e115 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:08.827748 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d5ef24c4-1169-4de5-ac08-8827abb6e115 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:08.828306 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d5ef24c4-1169-4de5-ac08-8827abb6e115 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:08.829157 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d5ef24c4-1169-4de5-ac08-8827abb6e115 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:08.830273 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d5ef24c4-1169-4de5-ac08-8827abb6e115 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:08.878988 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-bb780dd5-6f70-4e9c-9c28-6dbe15d6a103 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:08.886269 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-bb780dd5-6f70-4e9c-9c28-6dbe15d6a103 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.162780 Nov 19 03:25:08.886855 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 372/814] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:08 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:08.975784 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d5ef24c4-1169-4de5-ac08-8827abb6e115 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:08.983799 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d5ef24c4-1169-4de5-ac08-8827abb6e115 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.166786 Nov 19 03:25:08.984302 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 443/815] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:08 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:09.903458 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e8159625-f8df-440e-8c61-fcfbb3ea4356 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:09.904058 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e8159625-f8df-440e-8c61-fcfbb3ea4356 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:09.911515 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e8159625-f8df-440e-8c61-fcfbb3ea4356 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:09.911955 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e8159625-f8df-440e-8c61-fcfbb3ea4356 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:09.912722 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e8159625-f8df-440e-8c61-fcfbb3ea4356 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:09.913151 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e8159625-f8df-440e-8c61-fcfbb3ea4356 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:10.000584 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-28dc015d-14e6-4d5b-a611-d5b352d91793 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:10.001486 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-28dc015d-14e6-4d5b-a611-d5b352d91793 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:10.008139 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-28dc015d-14e6-4d5b-a611-d5b352d91793 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:10.008592 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-28dc015d-14e6-4d5b-a611-d5b352d91793 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:10.009373 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-28dc015d-14e6-4d5b-a611-d5b352d91793 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:10.009799 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-28dc015d-14e6-4d5b-a611-d5b352d91793 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:10.050236 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e8159625-f8df-440e-8c61-fcfbb3ea4356 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:10.057530 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e8159625-f8df-440e-8c61-fcfbb3ea4356 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.157621 Nov 19 03:25:10.058107 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 373/816] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:09 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:10.159810 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-28dc015d-14e6-4d5b-a611-d5b352d91793 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:10.167562 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-28dc015d-14e6-4d5b-a611-d5b352d91793 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.170587 Nov 19 03:25:10.168132 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 444/817] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:09 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:11.079142 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e58a1831-d265-4dc1-9cba-21ff8d56e744 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:11.080152 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e58a1831-d265-4dc1-9cba-21ff8d56e744 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:11.087851 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e58a1831-d265-4dc1-9cba-21ff8d56e744 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:11.088294 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e58a1831-d265-4dc1-9cba-21ff8d56e744 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:11.089071 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e58a1831-d265-4dc1-9cba-21ff8d56e744 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:11.089500 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e58a1831-d265-4dc1-9cba-21ff8d56e744 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:11.184780 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2ecab214-270c-41c7-b5bb-b89168b3fb29 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:11.185440 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2ecab214-270c-41c7-b5bb-b89168b3fb29 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:11.192229 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2ecab214-270c-41c7-b5bb-b89168b3fb29 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:11.192669 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2ecab214-270c-41c7-b5bb-b89168b3fb29 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:11.193443 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2ecab214-270c-41c7-b5bb-b89168b3fb29 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:11.193872 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2ecab214-270c-41c7-b5bb-b89168b3fb29 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:11.223964 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e58a1831-d265-4dc1-9cba-21ff8d56e744 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:11.231743 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e58a1831-d265-4dc1-9cba-21ff8d56e744 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.156285 Nov 19 03:25:11.232574 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 374/818] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:11 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:11.344372 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2ecab214-270c-41c7-b5bb-b89168b3fb29 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:11.353415 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2ecab214-270c-41c7-b5bb-b89168b3fb29 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.172232 Nov 19 03:25:11.354003 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 445/819] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:11 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:11.485450 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-b0e6a18f-8583-420f-8bce-e3b9cccbc299 req-f598d332-0a31-41e4-aa79-66a08d1f8410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24f94eb-65e4-4d85-9117-de9e6c26c0e8", "name": "network-vif-plugged", "status": "completed", "tag": "24528e7f-8831-4104-bcd0-4a6a28f9fb12"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:25:11.488185 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:25:11.488185 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:25:11.496255 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-b0e6a18f-8583-420f-8bce-e3b9cccbc299 req-f598d332-0a31-41e4-aa79-66a08d1f8410 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:11.496949 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-b0e6a18f-8583-420f-8bce-e3b9cccbc299 req-f598d332-0a31-41e4-aa79-66a08d1f8410 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:11.510741 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-b0e6a18f-8583-420f-8bce-e3b9cccbc299 req-f598d332-0a31-41e4-aa79-66a08d1f8410 service nova] Creating event network-vif-plugged:24528e7f-8831-4104-bcd0-4a6a28f9fb12 for instance e24f94eb-65e4-4d85-9117-de9e6c26c0e8 on hv-cinder-81803 Nov 19 03:25:11.515876 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-b0e6a18f-8583-420f-8bce-e3b9cccbc299 req-f598d332-0a31-41e4-aa79-66a08d1f8410 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034716 Nov 19 03:25:11.516666 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 375/820] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:25:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:25:12.248725 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0d810697-12df-49af-8ef6-5a8359fc70cf tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:12.249328 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0d810697-12df-49af-8ef6-5a8359fc70cf tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:12.256312 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d810697-12df-49af-8ef6-5a8359fc70cf tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:12.256312 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d810697-12df-49af-8ef6-5a8359fc70cf tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:12.257000 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d810697-12df-49af-8ef6-5a8359fc70cf tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:12.257437 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d810697-12df-49af-8ef6-5a8359fc70cf tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:12.371757 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e387b02d-4174-4d09-9f70-36a5a152a7b1 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:12.372450 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e387b02d-4174-4d09-9f70-36a5a152a7b1 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:12.379388 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e387b02d-4174-4d09-9f70-36a5a152a7b1 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:12.379833 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e387b02d-4174-4d09-9f70-36a5a152a7b1 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:12.380612 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e387b02d-4174-4d09-9f70-36a5a152a7b1 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:12.381041 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e387b02d-4174-4d09-9f70-36a5a152a7b1 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:12.392333 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0d810697-12df-49af-8ef6-5a8359fc70cf tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:12.400037 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0d810697-12df-49af-8ef6-5a8359fc70cf tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.154865 Nov 19 03:25:12.400621 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 446/821] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:12 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:12.536780 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e387b02d-4174-4d09-9f70-36a5a152a7b1 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:12.544667 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e387b02d-4174-4d09-9f70-36a5a152a7b1 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1758 microversion: 2.1 time: 0.177294 Nov 19 03:25:12.545219 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 376/822] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:12 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:13.417626 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0f1f351b-0390-44b4-827f-ca9212b4ff56 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:13.419114 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0f1f351b-0390-44b4-827f-ca9212b4ff56 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:13.429872 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0f1f351b-0390-44b4-827f-ca9212b4ff56 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:13.430360 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0f1f351b-0390-44b4-827f-ca9212b4ff56 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:13.431190 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0f1f351b-0390-44b4-827f-ca9212b4ff56 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:13.432381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0f1f351b-0390-44b4-827f-ca9212b4ff56 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:13.564871 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3998b29d-dfbc-4158-b98f-7038d6ae1a3f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:13.565478 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3998b29d-dfbc-4158-b98f-7038d6ae1a3f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:13.571799 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3998b29d-dfbc-4158-b98f-7038d6ae1a3f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:13.572228 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3998b29d-dfbc-4158-b98f-7038d6ae1a3f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:13.573000 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3998b29d-dfbc-4158-b98f-7038d6ae1a3f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:13.573430 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3998b29d-dfbc-4158-b98f-7038d6ae1a3f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:13.581718 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0f1f351b-0390-44b4-827f-ca9212b4ff56 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:13.591087 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0f1f351b-0390-44b4-827f-ca9212b4ff56 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1314 microversion: 2.1 time: 0.177381 Nov 19 03:25:13.601112 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 447/823] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:13 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:13.724567 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-3998b29d-dfbc-4158-b98f-7038d6ae1a3f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:13.732474 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3998b29d-dfbc-4158-b98f-7038d6ae1a3f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1761 microversion: 2.1 time: 0.171620 Nov 19 03:25:13.733122 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 377/824] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:13 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1761 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:14.608592 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-132b8f60-9906-45a7-bf42-db6575f2e907 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:14.609489 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-132b8f60-9906-45a7-bf42-db6575f2e907 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:14.615926 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-132b8f60-9906-45a7-bf42-db6575f2e907 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:14.616517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-132b8f60-9906-45a7-bf42-db6575f2e907 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:14.617408 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-132b8f60-9906-45a7-bf42-db6575f2e907 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:14.617973 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-132b8f60-9906-45a7-bf42-db6575f2e907 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:14.835766 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-132b8f60-9906-45a7-bf42-db6575f2e907 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:14.843463 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-132b8f60-9906-45a7-bf42-db6575f2e907 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1497 microversion: 2.1 time: 0.238456 Nov 19 03:25:14.855369 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 448/825] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:14 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1497 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:15.412477 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-64779223-602f-4c67-b981-6d5d31397889 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:15.413259 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-64779223-602f-4c67-b981-6d5d31397889 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:15.420205 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-64779223-602f-4c67-b981-6d5d31397889 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:15.420655 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-64779223-602f-4c67-b981-6d5d31397889 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:15.421444 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-64779223-602f-4c67-b981-6d5d31397889 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:15.421875 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-64779223-602f-4c67-b981-6d5d31397889 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:15.450845 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-64779223-602f-4c67-b981-6d5d31397889 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Going to try to terminate instance {{(pid=116066) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:25:15.569540 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-64779223-602f-4c67-b981-6d5d31397889 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 204 len: 0 microversion: 2.1 time: 0.161638 Nov 19 03:25:15.570773 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 378/826] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:25:15 2021] DELETE /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:25:15.582265 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-578aff3f-3382-4f7f-a8ec-220431f9772f tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:15.583080 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-578aff3f-3382-4f7f-a8ec-220431f9772f tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:15.590828 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-578aff3f-3382-4f7f-a8ec-220431f9772f tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:15.591341 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-578aff3f-3382-4f7f-a8ec-220431f9772f tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:15.592424 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-578aff3f-3382-4f7f-a8ec-220431f9772f tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:15.593051 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-578aff3f-3382-4f7f-a8ec-220431f9772f tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:15.897859 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-578aff3f-3382-4f7f-a8ec-220431f9772f tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:15.906438 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-578aff3f-3382-4f7f-a8ec-220431f9772f tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1503 microversion: 2.1 time: 0.330917 Nov 19 03:25:15.916963 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 449/827] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:15 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:16.925435 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5b50265a-d20a-4495-abb8-c4eb2c2ea83a tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:16.926231 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5b50265a-d20a-4495-abb8-c4eb2c2ea83a tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:16.933034 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5b50265a-d20a-4495-abb8-c4eb2c2ea83a tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:16.933778 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5b50265a-d20a-4495-abb8-c4eb2c2ea83a tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:16.934672 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5b50265a-d20a-4495-abb8-c4eb2c2ea83a tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:16.935178 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5b50265a-d20a-4495-abb8-c4eb2c2ea83a tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:17.091742 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5b50265a-d20a-4495-abb8-c4eb2c2ea83a tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:17.100544 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5b50265a-d20a-4495-abb8-c4eb2c2ea83a tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1503 microversion: 2.1 time: 0.179454 Nov 19 03:25:17.101111 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 379/828] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:16 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:17.812270 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-cdd21516-1401-43c4-ad61-b6efbc70d416 req-2b90358f-153f-497f-83d8-61d8c35a3f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24f94eb-65e4-4d85-9117-de9e6c26c0e8", "name": "network-vif-deleted", "tag": "24528e7f-8831-4104-bcd0-4a6a28f9fb12"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:25:17.815309 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:25:17.815309 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:25:17.823711 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-cdd21516-1401-43c4-ad61-b6efbc70d416 req-2b90358f-153f-497f-83d8-61d8c35a3f6e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:17.824259 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-cdd21516-1401-43c4-ad61-b6efbc70d416 req-2b90358f-153f-497f-83d8-61d8c35a3f6e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:17.837832 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-cdd21516-1401-43c4-ad61-b6efbc70d416 req-2b90358f-153f-497f-83d8-61d8c35a3f6e service nova] Creating event network-vif-deleted:24528e7f-8831-4104-bcd0-4a6a28f9fb12 for instance e24f94eb-65e4-4d85-9117-de9e6c26c0e8 on hv-cinder-81803 Nov 19 03:25:17.847935 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-cdd21516-1401-43c4-ad61-b6efbc70d416 req-2b90358f-153f-497f-83d8-61d8c35a3f6e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039624 Nov 19 03:25:17.848767 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 450/829] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:25:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:25:18.117976 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-608f0762-284c-4378-92c2-75a4058f741e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:18.119237 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-608f0762-284c-4378-92c2-75a4058f741e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:18.153371 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-608f0762-284c-4378-92c2-75a4058f741e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:18.154123 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-608f0762-284c-4378-92c2-75a4058f741e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:18.155605 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-608f0762-284c-4378-92c2-75a4058f741e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:18.159593 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-608f0762-284c-4378-92c2-75a4058f741e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:18.253234 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-608f0762-284c-4378-92c2-75a4058f741e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:18.253945 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-608f0762-284c-4378-92c2-75a4058f741e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:18.254818 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.objects.instance [None req-608f0762-284c-4378-92c2-75a4058f741e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lazy-loading 'fault' on Instance uuid e24f94eb-65e4-4d85-9117-de9e6c26c0e8 {{(pid=116066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:25:18.317516 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-608f0762-284c-4378-92c2-75a4058f741e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:18.326057 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-608f0762-284c-4378-92c2-75a4058f741e tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 200 len: 1304 microversion: 2.1 time: 0.211693 Nov 19 03:25:18.327503 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 380/830] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:18 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 1304 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:19.345072 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8f99e755-9d7c-4dd8-a957-91eedc72dd73 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:19.345876 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8f99e755-9d7c-4dd8-a957-91eedc72dd73 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: e24f94eb-65e4-4d85-9117-de9e6c26c0e8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:19.352236 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f99e755-9d7c-4dd8-a957-91eedc72dd73 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:19.352725 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f99e755-9d7c-4dd8-a957-91eedc72dd73 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:19.353528 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f99e755-9d7c-4dd8-a957-91eedc72dd73 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:19.353965 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f99e755-9d7c-4dd8-a957-91eedc72dd73 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:19.369043 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-8f99e755-9d7c-4dd8-a957-91eedc72dd73 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] HTTP exception thrown: Instance e24f94eb-65e4-4d85-9117-de9e6c26c0e8 could not be found. Nov 19 03:25:19.369629 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8f99e755-9d7c-4dd8-a957-91eedc72dd73 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Returning 404 to user: Instance e24f94eb-65e4-4d85-9117-de9e6c26c0e8 could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:25:19.371108 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8f99e755-9d7c-4dd8-a957-91eedc72dd73 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8" status: 404 len: 111 microversion: 2.1 time: 0.030244 Nov 19 03:25:19.371284 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 451/831] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:19 2021] GET /compute/v2.1/servers/e24f94eb-65e4-4d85-9117-de9e6c26c0e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:25:19.476174 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1749335382", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "networks": [{"uuid": "2294e149-4611-4500-8734-b9b290b7e149"}]}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:25:19.542465 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.network.neutron [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] validate_networks() for [('2294e149-4611-4500-8734-b9b290b7e149', None, None, None, None, None)] {{(pid=116066) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:25:20.108292 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Flavor limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:25:20.108984 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Image limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:25:20.109571 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Flavor pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:25:20.110091 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Image pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:25:20.110682 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:25:20.122363 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:20.122993 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:20.124602 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:20.125141 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:20.144676 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Getting quotas for project 1c75c732daa4453ebbc81731ee7c28c3. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:25:20.149965 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Getting quotas for user 9e981b2dbe91448c88738ef2c13a083b and project 1c75c732daa4453ebbc81731ee7c28c3. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:25:20.168378 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Going to run 1 instances... {{(pid=116066) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:25:20.168378 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:25:20.245341 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0476eeb0-6e20-4a75-8b73-d138c5b6b768 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772608 Nov 19 03:25:20.246594 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 381/832] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:25:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:25:20.257184 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c6412652-66c1-4459-8d38-fdb7780916b7 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:20.263290 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c6412652-66c1-4459-8d38-fdb7780916b7 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:20.349393 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c6412652-66c1-4459-8d38-fdb7780916b7 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:20.362961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c6412652-66c1-4459-8d38-fdb7780916b7 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1214 microversion: 2.1 time: 0.106040 Nov 19 03:25:20.372894 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 452/833] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:20 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:21.383422 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7324903f-6fd9-43cc-b7c0-172ea5c362f8 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:21.384877 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7324903f-6fd9-43cc-b7c0-172ea5c362f8 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:21.401763 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7324903f-6fd9-43cc-b7c0-172ea5c362f8 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:21.402527 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7324903f-6fd9-43cc-b7c0-172ea5c362f8 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:21.405211 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7324903f-6fd9-43cc-b7c0-172ea5c362f8 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:21.408645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7324903f-6fd9-43cc-b7c0-172ea5c362f8 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:21.486355 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-7324903f-6fd9-43cc-b7c0-172ea5c362f8 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:21.494836 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7324903f-6fd9-43cc-b7c0-172ea5c362f8 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1266 microversion: 2.1 time: 0.116891 Nov 19 03:25:21.497512 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 382/834] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:21 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:22.516054 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-cdaf7cdd-7543-48e9-8598-c17e8e3c7db0 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:22.516991 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-cdaf7cdd-7543-48e9-8598-c17e8e3c7db0 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:22.530055 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cdaf7cdd-7543-48e9-8598-c17e8e3c7db0 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:22.531200 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cdaf7cdd-7543-48e9-8598-c17e8e3c7db0 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:22.532274 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cdaf7cdd-7543-48e9-8598-c17e8e3c7db0 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:22.533838 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cdaf7cdd-7543-48e9-8598-c17e8e3c7db0 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:22.620082 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-cdaf7cdd-7543-48e9-8598-c17e8e3c7db0 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:22.628917 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-cdaf7cdd-7543-48e9-8598-c17e8e3c7db0 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1272 microversion: 2.1 time: 0.118340 Nov 19 03:25:22.642660 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 453/835] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:22 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:23.653348 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-42bada0f-2640-4acc-8c00-c76c5f776fd2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:23.654090 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-42bada0f-2640-4acc-8c00-c76c5f776fd2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:23.664080 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-42bada0f-2640-4acc-8c00-c76c5f776fd2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:23.665306 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-42bada0f-2640-4acc-8c00-c76c5f776fd2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:23.666339 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-42bada0f-2640-4acc-8c00-c76c5f776fd2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:23.667574 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-42bada0f-2640-4acc-8c00-c76c5f776fd2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:24.058498 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-42bada0f-2640-4acc-8c00-c76c5f776fd2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:24.072785 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-42bada0f-2640-4acc-8c00-c76c5f776fd2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1314 microversion: 2.1 time: 0.428242 Nov 19 03:25:24.074306 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 383/836] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:23 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:25.053506 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-7f366084-5694-4fec-8d66-9ba059f54c2a req-3e90425c-b85f-4947-91f3-b26f7c9d429a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb0dd91-cffb-419a-98e0-1303f56b6f5f", "tag": "10fd1c81-7748-4cb6-96c7-885849640ee0"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:25:25.064099 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:25:25.064099 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:25:25.078611 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-7f366084-5694-4fec-8d66-9ba059f54c2a req-3e90425c-b85f-4947-91f3-b26f7c9d429a service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:25.079133 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-7f366084-5694-4fec-8d66-9ba059f54c2a req-3e90425c-b85f-4947-91f3-b26f7c9d429a service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:25.090192 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-40f1775b-cece-4dd4-8b71-4152e24560ab tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:25.091525 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-40f1775b-cece-4dd4-8b71-4152e24560ab tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:25.091957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-7f366084-5694-4fec-8d66-9ba059f54c2a req-3e90425c-b85f-4947-91f3-b26f7c9d429a service nova] Creating event network-changed:10fd1c81-7748-4cb6-96c7-885849640ee0 for instance 7bb0dd91-cffb-419a-98e0-1303f56b6f5f on hv-cinder-81803 Nov 19 03:25:25.101349 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-7f366084-5694-4fec-8d66-9ba059f54c2a req-3e90425c-b85f-4947-91f3-b26f7c9d429a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206420 Nov 19 03:25:25.101807 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 454/837] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:25:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:25:25.104096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-40f1775b-cece-4dd4-8b71-4152e24560ab tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:25.104549 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-40f1775b-cece-4dd4-8b71-4152e24560ab tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:25.106067 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-40f1775b-cece-4dd4-8b71-4152e24560ab tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:25.106537 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-40f1775b-cece-4dd4-8b71-4152e24560ab tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:25.299808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-923f6e98-fd2f-4fd7-abb6-392f5a1aa1c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Action: 'create', calling method: .version_select at 0x7f845a00a550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-884116023"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:25:25.315174 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-923f6e98-fd2f-4fd7-abb6-392f5a1aa1c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Getting quotas for project 0b123731cbb4468b8bae663587e792e7. Resources: {'key_pairs'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:25:25.319736 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-923f6e98-fd2f-4fd7-abb6-392f5a1aa1c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Getting quotas for user 46cac61c2b3543fb8be6fbab87677bb2 and project 0b123731cbb4468b8bae663587e792e7. Resources: {'key_pairs'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:25:25.333380 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: ERROR oslo.messaging._drivers.impl_rabbit [None req-923f6e98-fd2f-4fd7-abb6-392f5a1aa1c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [9689a5c0-0ef6-40e3-85b8-1d8d7c811689] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 19 03:25:25.343253 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-40f1775b-cece-4dd4-8b71-4152e24560ab tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:25.351443 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-40f1775b-cece-4dd4-8b71-4152e24560ab tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1314 microversion: 2.1 time: 0.264748 Nov 19 03:25:25.351960 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 384/838] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:25 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:26.352311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO oslo.messaging._drivers.impl_rabbit [None req-923f6e98-fd2f-4fd7-abb6-392f5a1aa1c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [9689a5c0-0ef6-40e3-85b8-1d8d7c811689] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 56718. Nov 19 03:25:26.368383 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-af7a3721-746e-492c-9d66-796d8ac78a11 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:26.369937 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-af7a3721-746e-492c-9d66-796d8ac78a11 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:26.388514 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af7a3721-746e-492c-9d66-796d8ac78a11 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:26.390329 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af7a3721-746e-492c-9d66-796d8ac78a11 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:26.396201 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af7a3721-746e-492c-9d66-796d8ac78a11 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:26.396967 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af7a3721-746e-492c-9d66-796d8ac78a11 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:26.561742 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-af7a3721-746e-492c-9d66-796d8ac78a11 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:26.572663 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-af7a3721-746e-492c-9d66-796d8ac78a11 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1314 microversion: 2.1 time: 0.208311 Nov 19 03:25:26.577020 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-923f6e98-fd2f-4fd7-abb6-392f5a1aa1c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Getting quotas for project 0b123731cbb4468b8bae663587e792e7. Resources: {'key_pairs'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:25:26.582115 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-923f6e98-fd2f-4fd7-abb6-392f5a1aa1c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Getting quotas for user 46cac61c2b3543fb8be6fbab87677bb2 and project 0b123731cbb4468b8bae663587e792e7. Resources: {'key_pairs'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:25:26.587416 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 385/839] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:26 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:26.599379 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-923f6e98-fd2f-4fd7-abb6-392f5a1aa1c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 1.401378 Nov 19 03:25:26.605037 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 455/840] 10.222.0.47 () {60 vars in 1157 bytes} [Fri Nov 19 03:25:25 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:27.604304 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0a67e1f7-81a5-4672-95f0-f96de63ce63b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:27.605007 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0a67e1f7-81a5-4672-95f0-f96de63ce63b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:27.612366 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a67e1f7-81a5-4672-95f0-f96de63ce63b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:27.613148 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a67e1f7-81a5-4672-95f0-f96de63ce63b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:27.613951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a67e1f7-81a5-4672-95f0-f96de63ce63b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:27.614378 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a67e1f7-81a5-4672-95f0-f96de63ce63b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:27.754832 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0a67e1f7-81a5-4672-95f0-f96de63ce63b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:27.762333 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0a67e1f7-81a5-4672-95f0-f96de63ce63b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1314 microversion: 2.1 time: 0.161771 Nov 19 03:25:27.762983 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 386/841] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:27 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:28.779768 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-36bc50a2-d855-4bf9-9772-6190471475d2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:28.780492 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-36bc50a2-d855-4bf9-9772-6190471475d2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:28.787328 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-36bc50a2-d855-4bf9-9772-6190471475d2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:28.787769 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-36bc50a2-d855-4bf9-9772-6190471475d2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:28.788532 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-36bc50a2-d855-4bf9-9772-6190471475d2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:28.788959 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-36bc50a2-d855-4bf9-9772-6190471475d2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:28.925214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-36bc50a2-d855-4bf9-9772-6190471475d2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:28.932724 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-36bc50a2-d855-4bf9-9772-6190471475d2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1314 microversion: 2.1 time: 0.157022 Nov 19 03:25:28.933300 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 456/842] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:28 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:29.948927 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-73265d89-cc4a-45d4-8447-a327923eaea3 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:29.949529 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-73265d89-cc4a-45d4-8447-a327923eaea3 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:29.956071 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73265d89-cc4a-45d4-8447-a327923eaea3 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:29.956514 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73265d89-cc4a-45d4-8447-a327923eaea3 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:29.957285 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73265d89-cc4a-45d4-8447-a327923eaea3 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:29.957719 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73265d89-cc4a-45d4-8447-a327923eaea3 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:30.089374 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-73265d89-cc4a-45d4-8447-a327923eaea3 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:30.099010 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-73265d89-cc4a-45d4-8447-a327923eaea3 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1314 microversion: 2.1 time: 0.153470 Nov 19 03:25:30.106985 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 387/843] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:29 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:31.116930 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-87a81af9-7bf9-4f30-8844-cf83fbe2fe4c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:31.117582 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-87a81af9-7bf9-4f30-8844-cf83fbe2fe4c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:31.123927 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-87a81af9-7bf9-4f30-8844-cf83fbe2fe4c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:31.124379 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-87a81af9-7bf9-4f30-8844-cf83fbe2fe4c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:31.125172 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-87a81af9-7bf9-4f30-8844-cf83fbe2fe4c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:31.125612 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-87a81af9-7bf9-4f30-8844-cf83fbe2fe4c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:31.261603 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-87a81af9-7bf9-4f30-8844-cf83fbe2fe4c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:31.269077 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-87a81af9-7bf9-4f30-8844-cf83fbe2fe4c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1314 microversion: 2.1 time: 0.155746 Nov 19 03:25:31.269660 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 457/844] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:31 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:31.562358 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-2bae6a8d-15f4-42ba-a207-3d76bbaf33a9 req-fe8bcd70-9846-4e2e-b587-e01e163db496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb0dd91-cffb-419a-98e0-1303f56b6f5f", "name": "network-vif-plugged", "status": "completed", "tag": "10fd1c81-7748-4cb6-96c7-885849640ee0"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:25:31.563966 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:25:31.563966 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:25:31.577387 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-2bae6a8d-15f4-42ba-a207-3d76bbaf33a9 req-fe8bcd70-9846-4e2e-b587-e01e163db496 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:31.577387 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-2bae6a8d-15f4-42ba-a207-3d76bbaf33a9 req-fe8bcd70-9846-4e2e-b587-e01e163db496 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:31.590560 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-2bae6a8d-15f4-42ba-a207-3d76bbaf33a9 req-fe8bcd70-9846-4e2e-b587-e01e163db496 service nova] Creating event network-vif-plugged:10fd1c81-7748-4cb6-96c7-885849640ee0 for instance 7bb0dd91-cffb-419a-98e0-1303f56b6f5f on hv-cinder-81803 Nov 19 03:25:31.596775 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-2bae6a8d-15f4-42ba-a207-3d76bbaf33a9 req-fe8bcd70-9846-4e2e-b587-e01e163db496 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037804 Nov 19 03:25:31.597369 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 388/845] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:25:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:25:32.286017 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d2dfe989-2687-4c1c-836d-ed88260699c2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:32.286847 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d2dfe989-2687-4c1c-836d-ed88260699c2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:32.293215 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d2dfe989-2687-4c1c-836d-ed88260699c2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:32.293729 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d2dfe989-2687-4c1c-836d-ed88260699c2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:32.294608 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d2dfe989-2687-4c1c-836d-ed88260699c2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:32.295038 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d2dfe989-2687-4c1c-836d-ed88260699c2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:32.427712 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d2dfe989-2687-4c1c-836d-ed88260699c2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:32.435335 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d2dfe989-2687-4c1c-836d-ed88260699c2 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1314 microversion: 2.1 time: 0.153048 Nov 19 03:25:32.435912 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 458/846] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:32 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:33.453462 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3dafbfbe-2340-4d7f-ab4a-00f3c03d47f9 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:33.454148 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3dafbfbe-2340-4d7f-ab4a-00f3c03d47f9 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:33.461465 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3dafbfbe-2340-4d7f-ab4a-00f3c03d47f9 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:33.461936 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3dafbfbe-2340-4d7f-ab4a-00f3c03d47f9 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:33.462791 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3dafbfbe-2340-4d7f-ab4a-00f3c03d47f9 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:33.463243 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3dafbfbe-2340-4d7f-ab4a-00f3c03d47f9 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:33.603243 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-3dafbfbe-2340-4d7f-ab4a-00f3c03d47f9 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:33.610873 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3dafbfbe-2340-4d7f-ab4a-00f3c03d47f9 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1314 microversion: 2.1 time: 0.161185 Nov 19 03:25:33.611879 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 389/847] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:33 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:34.628723 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c99313f8-110b-42f1-b0bf-374b3e9dd4f6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:34.629401 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c99313f8-110b-42f1-b0bf-374b3e9dd4f6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:34.636796 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c99313f8-110b-42f1-b0bf-374b3e9dd4f6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:34.637245 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c99313f8-110b-42f1-b0bf-374b3e9dd4f6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:34.638030 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c99313f8-110b-42f1-b0bf-374b3e9dd4f6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:34.638464 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c99313f8-110b-42f1-b0bf-374b3e9dd4f6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:34.777265 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c99313f8-110b-42f1-b0bf-374b3e9dd4f6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:34.785521 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c99313f8-110b-42f1-b0bf-374b3e9dd4f6 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1497 microversion: 2.1 time: 0.160551 Nov 19 03:25:34.786088 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 459/848] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:34 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:35.351946 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2da74122-6ab8-4796-8c6d-80c3b831577b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:35.352536 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2da74122-6ab8-4796-8c6d-80c3b831577b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:35.358556 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2da74122-6ab8-4796-8c6d-80c3b831577b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:35.358998 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2da74122-6ab8-4796-8c6d-80c3b831577b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:35.359759 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2da74122-6ab8-4796-8c6d-80c3b831577b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:35.360186 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2da74122-6ab8-4796-8c6d-80c3b831577b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:35.395488 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2da74122-6ab8-4796-8c6d-80c3b831577b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Going to try to terminate instance {{(pid=116066) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:25:35.478244 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2da74122-6ab8-4796-8c6d-80c3b831577b tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 204 len: 0 microversion: 2.1 time: 0.130102 Nov 19 03:25:35.479009 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 390/849] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:25:35 2021] DELETE /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 03:25:35.488779 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d477f218-a065-471f-8f99-7d623502c215 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:35.489388 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d477f218-a065-471f-8f99-7d623502c215 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:35.495404 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d477f218-a065-471f-8f99-7d623502c215 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:35.495928 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d477f218-a065-471f-8f99-7d623502c215 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:35.496922 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d477f218-a065-471f-8f99-7d623502c215 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:35.497349 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d477f218-a065-471f-8f99-7d623502c215 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:35.636498 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d477f218-a065-471f-8f99-7d623502c215 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:35.644936 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d477f218-a065-471f-8f99-7d623502c215 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1503 microversion: 2.1 time: 0.160806 Nov 19 03:25:35.645489 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 460/850] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:35 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:36.666240 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0f5d0985-d03c-46ca-b1b2-7e2ecff1dc5c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:36.667085 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0f5d0985-d03c-46ca-b1b2-7e2ecff1dc5c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:36.673446 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0f5d0985-d03c-46ca-b1b2-7e2ecff1dc5c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:36.673911 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0f5d0985-d03c-46ca-b1b2-7e2ecff1dc5c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:36.675426 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0f5d0985-d03c-46ca-b1b2-7e2ecff1dc5c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:36.675867 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0f5d0985-d03c-46ca-b1b2-7e2ecff1dc5c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:36.814064 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0f5d0985-d03c-46ca-b1b2-7e2ecff1dc5c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:36.821381 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0f5d0985-d03c-46ca-b1b2-7e2ecff1dc5c tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1503 microversion: 2.1 time: 0.159147 Nov 19 03:25:36.821943 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 391/851] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:36 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:37.832887 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-6bcf1ca7-b07f-4419-bbea-20a6ac09249b req-df7bc126-5504-4345-8ccf-d9bbd7ed1cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb0dd91-cffb-419a-98e0-1303f56b6f5f", "name": "network-vif-deleted", "tag": "10fd1c81-7748-4cb6-96c7-885849640ee0"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:25:37.834433 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:25:37.834433 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:25:37.840721 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b1368088-6da0-4967-9944-6710a5e4ae3d tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:37.841347 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b1368088-6da0-4967-9944-6710a5e4ae3d tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:37.841798 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-6bcf1ca7-b07f-4419-bbea-20a6ac09249b req-df7bc126-5504-4345-8ccf-d9bbd7ed1cc8 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:37.842253 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-6bcf1ca7-b07f-4419-bbea-20a6ac09249b req-df7bc126-5504-4345-8ccf-d9bbd7ed1cc8 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:37.848241 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b1368088-6da0-4967-9944-6710a5e4ae3d tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:37.848690 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b1368088-6da0-4967-9944-6710a5e4ae3d tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:37.849474 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b1368088-6da0-4967-9944-6710a5e4ae3d tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:37.850076 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b1368088-6da0-4967-9944-6710a5e4ae3d tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:37.853982 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-6bcf1ca7-b07f-4419-bbea-20a6ac09249b req-df7bc126-5504-4345-8ccf-d9bbd7ed1cc8 service nova] Creating event network-vif-deleted:10fd1c81-7748-4cb6-96c7-885849640ee0 for instance 7bb0dd91-cffb-419a-98e0-1303f56b6f5f on hv-cinder-81803 Nov 19 03:25:37.859070 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-6bcf1ca7-b07f-4419-bbea-20a6ac09249b req-df7bc126-5504-4345-8ccf-d9bbd7ed1cc8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030576 Nov 19 03:25:37.860488 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 461/852] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:25:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:25:37.918160 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b1368088-6da0-4967-9944-6710a5e4ae3d tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981b2dbe91448c88738ef2c13a083b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c75c732daa4453ebbc81731ee7c28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:37.927197 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b1368088-6da0-4967-9944-6710a5e4ae3d tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 200 len: 1461 microversion: 2.1 time: 0.091958 Nov 19 03:25:37.927772 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 392/853] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:37 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 1461 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:25:38.945745 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9c514875-4415-44cc-b621-463e556c31d5 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:38.946384 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9c514875-4415-44cc-b621-463e556c31d5 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] [instance: 7bb0dd91-cffb-419a-98e0-1303f56b6f5f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:38.952401 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9c514875-4415-44cc-b621-463e556c31d5 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:38.952844 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9c514875-4415-44cc-b621-463e556c31d5 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:38.953623 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9c514875-4415-44cc-b621-463e556c31d5 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:38.954030 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9c514875-4415-44cc-b621-463e556c31d5 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:38.967196 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-9c514875-4415-44cc-b621-463e556c31d5 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] HTTP exception thrown: Instance 7bb0dd91-cffb-419a-98e0-1303f56b6f5f could not be found. Nov 19 03:25:38.967763 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9c514875-4415-44cc-b621-463e556c31d5 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] Returning 404 to user: Instance 7bb0dd91-cffb-419a-98e0-1303f56b6f5f could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:25:38.968558 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9c514875-4415-44cc-b621-463e556c31d5 tempest-VolumesActionsTest-529784733 tempest-VolumesActionsTest-529784733-project] 10.222.0.47 "GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f" status: 404 len: 111 microversion: 2.1 time: 0.027421 Nov 19 03:25:38.969068 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 462/854] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:25:38 2021] GET /compute/v2.1/servers/7bb0dd91-cffb-419a-98e0-1303f56b6f5f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:25:40.350115 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3829601c-fc84-4b5d-a3a1-f46cf04775c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:40.350725 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3829601c-fc84-4b5d-a3a1-f46cf04775c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:40.356566 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3829601c-fc84-4b5d-a3a1-f46cf04775c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:40.357006 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3829601c-fc84-4b5d-a3a1-f46cf04775c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:40.357768 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3829601c-fc84-4b5d-a3a1-f46cf04775c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:40.358199 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3829601c-fc84-4b5d-a3a1-f46cf04775c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:40.387434 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3829601c-fc84-4b5d-a3a1-f46cf04775c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments/6ba4acb0-8ae6-4900-b2ef-f13a5fbae966" status: 200 len: 194 microversion: 2.20 time: 0.146380 Nov 19 03:25:40.388005 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 393/855] 10.222.0.47 () {60 vars in 1453 bytes} [Fri Nov 19 03:25:40 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments/6ba4acb0-8ae6-4900-b2ef-f13a5fbae966 => generated 194 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:25:40.447256 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-124fb13b-dbd5-4110-8cc8-ba5c640d50b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:40.447824 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-124fb13b-dbd5-4110-8cc8-ba5c640d50b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:40.453876 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-124fb13b-dbd5-4110-8cc8-ba5c640d50b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:40.454312 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-124fb13b-dbd5-4110-8cc8-ba5c640d50b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:40.455102 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-124fb13b-dbd5-4110-8cc8-ba5c640d50b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:40.455530 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-124fb13b-dbd5-4110-8cc8-ba5c640d50b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:40.535861 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-124fb13b-dbd5-4110-8cc8-ba5c640d50b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lazy-loading 'services' on Instance uuid 8641ae42-77ad-4054-8073-76018892c1d8 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:25:40.606942 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-124fb13b-dbd5-4110-8cc8-ba5c640d50b4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments/6ba4acb0-8ae6-4900-b2ef-f13a5fbae966" status: 202 len: 0 microversion: 2.20 time: 0.163070 Nov 19 03:25:40.607791 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 463/856] 10.222.0.47 () {60 vars in 1456 bytes} [Fri Nov 19 03:25:40 2021] DELETE /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments/6ba4acb0-8ae6-4900-b2ef-f13a5fbae966 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:25:40.617922 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ac662705-a712-4464-be3c-7dcef87134a2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:40.618855 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ac662705-a712-4464-be3c-7dcef87134a2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:40.625217 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ac662705-a712-4464-be3c-7dcef87134a2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:40.625707 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ac662705-a712-4464-be3c-7dcef87134a2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:40.626674 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ac662705-a712-4464-be3c-7dcef87134a2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:40.627176 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ac662705-a712-4464-be3c-7dcef87134a2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:40.658097 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ac662705-a712-4464-be3c-7dcef87134a2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043778 Nov 19 03:25:40.658742 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 394/857] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Nov 19 03:25:40 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:25:41.669658 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c0e7fc04-b496-4d77-8573-9e6dd2485be9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:41.670752 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c0e7fc04-b496-4d77-8573-9e6dd2485be9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:41.677930 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c0e7fc04-b496-4d77-8573-9e6dd2485be9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:41.678375 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c0e7fc04-b496-4d77-8573-9e6dd2485be9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:41.679160 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c0e7fc04-b496-4d77-8573-9e6dd2485be9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:41.679586 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c0e7fc04-b496-4d77-8573-9e6dd2485be9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:41.708635 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c0e7fc04-b496-4d77-8573-9e6dd2485be9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043107 Nov 19 03:25:41.710663 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 464/858] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Nov 19 03:25:41 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:25:42.720025 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-546490ff-a4df-404b-af2f-ba876527aea8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:42.720928 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-546490ff-a4df-404b-af2f-ba876527aea8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:42.727621 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-546490ff-a4df-404b-af2f-ba876527aea8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:42.728072 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-546490ff-a4df-404b-af2f-ba876527aea8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:42.728968 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-546490ff-a4df-404b-af2f-ba876527aea8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:42.729469 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-546490ff-a4df-404b-af2f-ba876527aea8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:42.760899 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-546490ff-a4df-404b-af2f-ba876527aea8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044585 Nov 19 03:25:42.761647 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 395/859] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Nov 19 03:25:42 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:25:43.772046 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a39b1a04-b6a6-4955-b7a2-e64b3fa9c066 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:43.772952 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a39b1a04-b6a6-4955-b7a2-e64b3fa9c066 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:43.779287 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a39b1a04-b6a6-4955-b7a2-e64b3fa9c066 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:43.779736 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a39b1a04-b6a6-4955-b7a2-e64b3fa9c066 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:43.780512 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a39b1a04-b6a6-4955-b7a2-e64b3fa9c066 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:43.780949 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a39b1a04-b6a6-4955-b7a2-e64b3fa9c066 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:43.810561 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a39b1a04-b6a6-4955-b7a2-e64b3fa9c066 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042144 Nov 19 03:25:43.811286 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 465/860] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Nov 19 03:25:43 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:25:44.821398 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9d0d4aca-b10f-43bc-b981-31aa1bcb7ec1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:44.822287 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9d0d4aca-b10f-43bc-b981-31aa1bcb7ec1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:44.828502 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9d0d4aca-b10f-43bc-b981-31aa1bcb7ec1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:44.828940 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9d0d4aca-b10f-43bc-b981-31aa1bcb7ec1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:44.829753 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9d0d4aca-b10f-43bc-b981-31aa1bcb7ec1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:44.830157 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9d0d4aca-b10f-43bc-b981-31aa1bcb7ec1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:44.862142 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9d0d4aca-b10f-43bc-b981-31aa1bcb7ec1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044378 Nov 19 03:25:44.862925 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 396/861] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Nov 19 03:25:44 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:25:45.873073 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ff5e2692-fdfc-4db8-9739-1588917dff35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:45.873974 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ff5e2692-fdfc-4db8-9739-1588917dff35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:45.880701 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ff5e2692-fdfc-4db8-9739-1588917dff35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:45.881150 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ff5e2692-fdfc-4db8-9739-1588917dff35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:45.881923 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ff5e2692-fdfc-4db8-9739-1588917dff35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:45.882347 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ff5e2692-fdfc-4db8-9739-1588917dff35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:45.914810 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ff5e2692-fdfc-4db8-9739-1588917dff35 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045346 Nov 19 03:25:45.915394 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 466/862] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Nov 19 03:25:45 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:25:46.927222 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6e7c78b2-aaef-4991-ace2-8323070f4145 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:46.928117 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6e7c78b2-aaef-4991-ace2-8323070f4145 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:46.934382 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e7c78b2-aaef-4991-ace2-8323070f4145 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:46.934854 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e7c78b2-aaef-4991-ace2-8323070f4145 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:46.935664 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e7c78b2-aaef-4991-ace2-8323070f4145 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:46.936096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e7c78b2-aaef-4991-ace2-8323070f4145 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:46.965118 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6e7c78b2-aaef-4991-ace2-8323070f4145 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042166 Nov 19 03:25:46.965679 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 397/863] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Nov 19 03:25:46 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:25:47.977861 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-200409fd-79cf-4599-aaad-14bd4586a26c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:47.978805 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-200409fd-79cf-4599-aaad-14bd4586a26c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:47.985342 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-200409fd-79cf-4599-aaad-14bd4586a26c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:47.985885 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-200409fd-79cf-4599-aaad-14bd4586a26c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:47.986767 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-200409fd-79cf-4599-aaad-14bd4586a26c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:47.987941 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-200409fd-79cf-4599-aaad-14bd4586a26c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:48.021205 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-200409fd-79cf-4599-aaad-14bd4586a26c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047035 Nov 19 03:25:48.021664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 467/864] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Nov 19 03:25:47 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:25:48.080061 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-09f06b1c-6c3a-48bc-889a-cb603cbdf9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:48.080491 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-09f06b1c-6c3a-48bc-889a-cb603cbdf9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:48.086966 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09f06b1c-6c3a-48bc-889a-cb603cbdf9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:48.087408 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09f06b1c-6c3a-48bc-889a-cb603cbdf9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:48.088191 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09f06b1c-6c3a-48bc-889a-cb603cbdf9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:48.088610 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09f06b1c-6c3a-48bc-889a-cb603cbdf9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:48.113364 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-09f06b1c-6c3a-48bc-889a-cb603cbdf9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Going to try to terminate instance {{(pid=116066) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:25:48.199405 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-09f06b1c-6c3a-48bc-889a-cb603cbdf9fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 204 len: 0 microversion: 2.20 time: 0.122362 Nov 19 03:25:48.200511 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 398/865] 10.222.0.47 () {60 vars in 1279 bytes} [Fri Nov 19 03:25:48 2021] DELETE /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 03:25:48.208807 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-79d86b8e-f1de-437b-9268-eea91ddefc1a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:48.209512 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-79d86b8e-f1de-437b-9268-eea91ddefc1a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:48.215782 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-79d86b8e-f1de-437b-9268-eea91ddefc1a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:48.216303 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-79d86b8e-f1de-437b-9268-eea91ddefc1a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:48.217192 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-79d86b8e-f1de-437b-9268-eea91ddefc1a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:48.217625 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-79d86b8e-f1de-437b-9268-eea91ddefc1a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:48.353699 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-79d86b8e-f1de-437b-9268-eea91ddefc1a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:48.362420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-79d86b8e-f1de-437b-9268-eea91ddefc1a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:48.364265 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-79d86b8e-f1de-437b-9268-eea91ddefc1a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:48.365678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-79d86b8e-f1de-437b-9268-eea91ddefc1a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1721 microversion: 2.20 time: 0.161301 Nov 19 03:25:48.376976 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 468/866] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:25:48 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:25:49.387186 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-50be3be9-e353-444d-b5d4-423b5c9e0aa6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:49.388331 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-50be3be9-e353-444d-b5d4-423b5c9e0aa6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:49.397518 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-50be3be9-e353-444d-b5d4-423b5c9e0aa6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:49.398064 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-50be3be9-e353-444d-b5d4-423b5c9e0aa6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:49.398956 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-50be3be9-e353-444d-b5d4-423b5c9e0aa6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:49.399694 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-50be3be9-e353-444d-b5d4-423b5c9e0aa6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:49.806409 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-50be3be9-e353-444d-b5d4-423b5c9e0aa6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:49.815340 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-50be3be9-e353-444d-b5d4-423b5c9e0aa6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:49.817560 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-50be3be9-e353-444d-b5d4-423b5c9e0aa6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:49.818743 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-50be3be9-e353-444d-b5d4-423b5c9e0aa6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1721 microversion: 2.20 time: 0.438364 Nov 19 03:25:49.819297 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 399/867] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:25:49 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1721 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:25:50.836905 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9da31771-90b8-400e-9879-f94b86e4e165 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:50.837632 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9da31771-90b8-400e-9879-f94b86e4e165 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:50.848277 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9da31771-90b8-400e-9879-f94b86e4e165 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:50.848723 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9da31771-90b8-400e-9879-f94b86e4e165 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:50.849724 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9da31771-90b8-400e-9879-f94b86e4e165 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:50.850162 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9da31771-90b8-400e-9879-f94b86e4e165 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:51.038016 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9da31771-90b8-400e-9879-f94b86e4e165 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:51.043949 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9da31771-90b8-400e-9879-f94b86e4e165 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:51.045624 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9da31771-90b8-400e-9879-f94b86e4e165 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:51.046984 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9da31771-90b8-400e-9879-f94b86e4e165 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1721 microversion: 2.20 time: 0.213792 Nov 19 03:25:51.047921 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 469/868] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:25:50 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:25:52.052212 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-d294fcb4-91db-4dba-bd4e-05d8cf08a00f req-52996b39-f189-43d1-8d59-ee23df2783ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8641ae42-77ad-4054-8073-76018892c1d8", "name": "network-vif-deleted", "tag": "4b50d896-6a79-4185-a31c-1931a0b889be"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:25:52.054645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:25:52.054645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:25:52.068089 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-97ecc741-a070-4640-89e7-8adc150310a6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:52.069401 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-97ecc741-a070-4640-89e7-8adc150310a6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:52.080051 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97ecc741-a070-4640-89e7-8adc150310a6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:52.083226 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97ecc741-a070-4640-89e7-8adc150310a6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:52.084770 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97ecc741-a070-4640-89e7-8adc150310a6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:52.087335 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-d294fcb4-91db-4dba-bd4e-05d8cf08a00f req-52996b39-f189-43d1-8d59-ee23df2783ff service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:52.087877 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-97ecc741-a070-4640-89e7-8adc150310a6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:52.092146 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-d294fcb4-91db-4dba-bd4e-05d8cf08a00f req-52996b39-f189-43d1-8d59-ee23df2783ff service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:52.112403 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-d294fcb4-91db-4dba-bd4e-05d8cf08a00f req-52996b39-f189-43d1-8d59-ee23df2783ff service nova] Creating event network-vif-deleted:4b50d896-6a79-4185-a31c-1931a0b889be for instance 8641ae42-77ad-4054-8073-76018892c1d8 on hv-cinder-81803 Nov 19 03:25:52.120349 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-d294fcb4-91db-4dba-bd4e-05d8cf08a00f req-52996b39-f189-43d1-8d59-ee23df2783ff service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072931 Nov 19 03:25:52.124045 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 400/869] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:25:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:25:52.181243 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-97ecc741-a070-4640-89e7-8adc150310a6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:52.195019 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-97ecc741-a070-4640-89e7-8adc150310a6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:52.198257 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-97ecc741-a070-4640-89e7-8adc150310a6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:52.200028 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-97ecc741-a070-4640-89e7-8adc150310a6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 200 len: 1653 microversion: 2.20 time: 0.136836 Nov 19 03:25:52.201014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 470/870] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:25:52 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 1653 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:25:53.221959 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c53d9e65-e49d-4cea-84e4-d6beb47453bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:53.227032 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c53d9e65-e49d-4cea-84e4-d6beb47453bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:53.244670 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c53d9e65-e49d-4cea-84e4-d6beb47453bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:53.245494 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c53d9e65-e49d-4cea-84e4-d6beb47453bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:53.246579 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c53d9e65-e49d-4cea-84e4-d6beb47453bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:53.248646 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c53d9e65-e49d-4cea-84e4-d6beb47453bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:53.275650 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-c53d9e65-e49d-4cea-84e4-d6beb47453bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] HTTP exception thrown: Instance 8641ae42-77ad-4054-8073-76018892c1d8 could not be found. Nov 19 03:25:53.276320 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c53d9e65-e49d-4cea-84e4-d6beb47453bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Returning 404 to user: Instance 8641ae42-77ad-4054-8073-76018892c1d8 could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:25:53.277684 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c53d9e65-e49d-4cea-84e4-d6beb47453bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 404 len: 111 microversion: 2.20 time: 0.062270 Nov 19 03:25:53.282912 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 401/871] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:25:53 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 19 03:25:53.288300 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c1f0e395-3bec-44cc-8d0f-e30a43070f17 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '.version_select at 0x7f8459ff0d30>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:53.324280 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c1f0e395-3bec-44cc-8d0f-e30a43070f17 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-731532775" status: 204 len: 0 microversion: 2.20 time: 0.040818 Nov 19 03:25:53.325524 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 471/872] 10.222.0.47 () {60 vars in 1258 bytes} [Fri Nov 19 03:25:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-731532775 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 03:25:54.275882 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-92769f63-65e1-40f9-8873-c757be4b8733 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'create', calling method: .version_select at 0x7f845a26cb80>, body: {"keypair": {"name": "tempest-keypair-1390058591"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:25:54.305351 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-92769f63-65e1-40f9-8873-c757be4b8733 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Getting quotas for project fcaf6436c60844aaba3497db6db06391. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:25:54.312292 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-92769f63-65e1-40f9-8873-c757be4b8733 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Getting quotas for user 7badb98be6a6455c804f8960482cdceb and project fcaf6436c60844aaba3497db6db06391. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:25:54.458404 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-92769f63-65e1-40f9-8873-c757be4b8733 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Getting quotas for project fcaf6436c60844aaba3497db6db06391. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:25:54.463495 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-92769f63-65e1-40f9-8873-c757be4b8733 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Getting quotas for user 7badb98be6a6455c804f8960482cdceb and project fcaf6436c60844aaba3497db6db06391. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:25:54.479742 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-92769f63-65e1-40f9-8873-c757be4b8733 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.207733 Nov 19 03:25:54.486533 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 402/873] 10.222.0.47 () {62 vars in 1198 bytes} [Fri Nov 19 03:25:54 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 209 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Nov 19 03:25:56.378253 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-197702047", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc33bde6-1f11-4e70-b114-c741f5e152cf"}], "security_groups": [{"name": "tempest-securitygroup--2102045994"}], "key_name": "tempest-keypair-1390058591", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:25:56.494876 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.network.neutron [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] validate_networks() for [('dc33bde6-1f11-4e70-b114-c741f5e152cf', None, None, None, None, None)] {{(pid=116065) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:25:56.972673 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Flavor limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:25:56.972673 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Image limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:25:56.973441 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Flavor pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:25:56.973931 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Image pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:25:56.974402 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:25:56.986205 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:56.986761 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:56.988620 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:56.989309 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:57.006666 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Getting quotas for project fcaf6436c60844aaba3497db6db06391. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:25:57.011129 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Getting quotas for user 7badb98be6a6455c804f8960482cdceb and project fcaf6436c60844aaba3497db6db06391. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:25:57.026848 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Going to run 1 instances... {{(pid=116065) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:25:57.029429 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:25:57.085380 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ceb8e526-c341-435f-9de9-ec684deb1a76 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.710986 Nov 19 03:25:57.092047 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 472/874] 10.222.0.47 () {62 vars in 1187 bytes} [Fri Nov 19 03:25:56 2021] POST /compute/v2.1/servers => generated 402 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 19 03:25:57.097294 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8215a6bc-d761-4c4b-adf8-e854ca436aea tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:57.097916 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8215a6bc-d761-4c4b-adf8-e854ca436aea tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:57.171465 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8215a6bc-d761-4c4b-adf8-e854ca436aea tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:57.183282 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8215a6bc-d761-4c4b-adf8-e854ca436aea tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:57.185156 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8215a6bc-d761-4c4b-adf8-e854ca436aea tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:57.186541 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8215a6bc-d761-4c4b-adf8-e854ca436aea tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1281 microversion: 2.20 time: 0.094385 Nov 19 03:25:57.189185 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 403/875] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:25:57 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:25:58.208189 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6c784a7c-9c0a-4f0b-9e10-2ddb7bad2081 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:58.208891 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6c784a7c-9c0a-4f0b-9e10-2ddb7bad2081 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:58.216482 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6c784a7c-9c0a-4f0b-9e10-2ddb7bad2081 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:58.217468 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6c784a7c-9c0a-4f0b-9e10-2ddb7bad2081 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:58.219152 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6c784a7c-9c0a-4f0b-9e10-2ddb7bad2081 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:58.220014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6c784a7c-9c0a-4f0b-9e10-2ddb7bad2081 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:58.289818 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6c784a7c-9c0a-4f0b-9e10-2ddb7bad2081 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:58.300775 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6c784a7c-9c0a-4f0b-9e10-2ddb7bad2081 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:58.302737 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-6c784a7c-9c0a-4f0b-9e10-2ddb7bad2081 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:58.304155 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6c784a7c-9c0a-4f0b-9e10-2ddb7bad2081 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1333 microversion: 2.20 time: 0.100158 Nov 19 03:25:58.305056 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 473/876] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:25:58 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:25:58.789255 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1326494888", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-884116023", "security_groups": [{"name": "tempest-secgroup-smoke-1741082130"}], "block_device_mapping_v2": [{"uuid": "ed0d97ad-80a0-428e-94d7-ee8a010b8ffd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ec6214ac-d99f-413c-a1b4-78005c417695"}]}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:25:58.969810 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.network.neutron [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] validate_networks() for [('ec6214ac-d99f-413c-a1b4-78005c417695', None, None, None, None, None)] {{(pid=116066) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:25:59.325472 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-03408f6f-83e4-42e5-8922-4a945205a8fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:25:59.326867 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-03408f6f-83e4-42e5-8922-4a945205a8fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:25:59.335517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-03408f6f-83e4-42e5-8922-4a945205a8fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:59.336217 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-03408f6f-83e4-42e5-8922-4a945205a8fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:59.337194 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-03408f6f-83e4-42e5-8922-4a945205a8fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:59.339897 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-03408f6f-83e4-42e5-8922-4a945205a8fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:59.784787 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-03408f6f-83e4-42e5-8922-4a945205a8fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:59.794294 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-03408f6f-83e4-42e5-8922-4a945205a8fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:59.796515 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-03408f6f-83e4-42e5-8922-4a945205a8fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:25:59.798125 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-03408f6f-83e4-42e5-8922-4a945205a8fe tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1407 microversion: 2.20 time: 0.479372 Nov 19 03:25:59.810699 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 474/877] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:25:59 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:25:59.831534 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Flavor limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:25:59.832275 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Image limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:25:59.833007 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Flavor pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:25:59.833573 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Image pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:25:59.834149 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:25:59.848593 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:59.849321 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:59.850311 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:25:59.851868 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:25:59.887336 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Getting quotas for project 0b123731cbb4468b8bae663587e792e7. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:25:59.892018 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Getting quotas for user 46cac61c2b3543fb8be6fbab87677bb2 and project 0b123731cbb4468b8bae663587e792e7. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:25:59.960083 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Going to run 1 instances... {{(pid=116066) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:25:59.962682 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed0d97ad-80a0-428e-94d7-ee8a010b8ffd',volume_size=None,volume_type=None)] {{(pid=116066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:26:00.131432 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-08484895-656f-4878-9ff6-17d52c8238b3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.345886 Nov 19 03:26:00.132355 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 404/878] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:25:58 2021] POST /compute/v2.1/servers => generated 406 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:26:00.141951 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-416bb231-5a61-4c57-bed2-b8de5ed5c29d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:00.142575 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-416bb231-5a61-4c57-bed2-b8de5ed5c29d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:00.223228 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-416bb231-5a61-4c57-bed2-b8de5ed5c29d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:00.229781 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-416bb231-5a61-4c57-bed2-b8de5ed5c29d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1094 microversion: 2.1 time: 0.091307 Nov 19 03:26:00.243058 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 475/879] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:00 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1094 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:00.758539 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-ac652583-31d6-4edf-8a0f-a3687885cbd9 req-1e08b3de-3742-4072-b569-29f2d13a8dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a889deb-2a02-4c52-8e3d-a666e5cbb1ba", "tag": "7ed0f6c9-ba15-4c53-b55d-b5d4da5d47f5"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:00.761173 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:26:00.761173 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:26:00.772969 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-ac652583-31d6-4edf-8a0f-a3687885cbd9 req-1e08b3de-3742-4072-b569-29f2d13a8dd2 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:00.773402 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-ac652583-31d6-4edf-8a0f-a3687885cbd9 req-1e08b3de-3742-4072-b569-29f2d13a8dd2 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:00.818304 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-fe84978d-a148-4888-8b81-867a3c177eeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:00.818934 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-fe84978d-a148-4888-8b81-867a3c177eeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:00.832122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fe84978d-a148-4888-8b81-867a3c177eeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:00.834344 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fe84978d-a148-4888-8b81-867a3c177eeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:00.836317 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fe84978d-a148-4888-8b81-867a3c177eeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:00.839123 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fe84978d-a148-4888-8b81-867a3c177eeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:00.843292 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-ac652583-31d6-4edf-8a0f-a3687885cbd9 req-1e08b3de-3742-4072-b569-29f2d13a8dd2 service nova] Creating event network-changed:7ed0f6c9-ba15-4c53-b55d-b5d4da5d47f5 for instance 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba on hv-cinder-81803 Nov 19 03:26:00.856614 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-ac652583-31d6-4edf-8a0f-a3687885cbd9 req-1e08b3de-3742-4072-b569-29f2d13a8dd2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101574 Nov 19 03:26:00.859512 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 405/880] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:26:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:26:01.140138 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-fe84978d-a148-4888-8b81-867a3c177eeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:01.160214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-fe84978d-a148-4888-8b81-867a3c177eeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:01.164772 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-fe84978d-a148-4888-8b81-867a3c177eeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:01.166151 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-fe84978d-a148-4888-8b81-867a3c177eeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1407 microversion: 2.20 time: 0.352493 Nov 19 03:26:01.167241 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 476/881] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:26:00 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:26:01.247867 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4d9041f1-106a-4da6-b63d-579fe8b5334a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:01.248722 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4d9041f1-106a-4da6-b63d-579fe8b5334a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:01.256089 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4d9041f1-106a-4da6-b63d-579fe8b5334a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:01.256890 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4d9041f1-106a-4da6-b63d-579fe8b5334a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:01.258116 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4d9041f1-106a-4da6-b63d-579fe8b5334a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:01.259000 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4d9041f1-106a-4da6-b63d-579fe8b5334a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:01.332513 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-4d9041f1-106a-4da6-b63d-579fe8b5334a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:01.341507 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4d9041f1-106a-4da6-b63d-579fe8b5334a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1192 microversion: 2.1 time: 0.097929 Nov 19 03:26:01.342553 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 406/882] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:01 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:02.184849 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b461eb43-f861-4e9f-9a19-45d8e73a0153 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:02.186610 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b461eb43-f861-4e9f-9a19-45d8e73a0153 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:02.199375 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b461eb43-f861-4e9f-9a19-45d8e73a0153 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:02.201967 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b461eb43-f861-4e9f-9a19-45d8e73a0153 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:02.203621 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b461eb43-f861-4e9f-9a19-45d8e73a0153 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:02.206745 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b461eb43-f861-4e9f-9a19-45d8e73a0153 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:02.360293 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c3e50d57-ee3e-4293-8778-e7be122010cb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:02.360907 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c3e50d57-ee3e-4293-8778-e7be122010cb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:02.372925 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c3e50d57-ee3e-4293-8778-e7be122010cb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:02.374213 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c3e50d57-ee3e-4293-8778-e7be122010cb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:02.376184 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c3e50d57-ee3e-4293-8778-e7be122010cb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:02.376783 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c3e50d57-ee3e-4293-8778-e7be122010cb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:02.480228 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c3e50d57-ee3e-4293-8778-e7be122010cb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:02.491922 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c3e50d57-ee3e-4293-8778-e7be122010cb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1210 microversion: 2.1 time: 0.136414 Nov 19 03:26:02.492784 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 407/883] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:02 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1210 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:02.523202 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b461eb43-f861-4e9f-9a19-45d8e73a0153 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:02.538850 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b461eb43-f861-4e9f-9a19-45d8e73a0153 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:02.541647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b461eb43-f861-4e9f-9a19-45d8e73a0153 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:02.543602 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b461eb43-f861-4e9f-9a19-45d8e73a0153 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1407 microversion: 2.20 time: 0.362968 Nov 19 03:26:02.557912 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 477/884] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:26:02 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1407 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:26:03.511246 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-afd76af5-e217-40fd-aadf-2aae2da361c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:03.511957 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-afd76af5-e217-40fd-aadf-2aae2da361c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:03.523661 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-afd76af5-e217-40fd-aadf-2aae2da361c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:03.527874 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-afd76af5-e217-40fd-aadf-2aae2da361c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:03.529222 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-afd76af5-e217-40fd-aadf-2aae2da361c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:03.535940 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-afd76af5-e217-40fd-aadf-2aae2da361c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:03.563452 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8bd21911-ec55-4f3a-9f1a-455b5987d303 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:03.564077 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8bd21911-ec55-4f3a-9f1a-455b5987d303 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:03.576452 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8bd21911-ec55-4f3a-9f1a-455b5987d303 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:03.577224 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8bd21911-ec55-4f3a-9f1a-455b5987d303 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:03.578256 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8bd21911-ec55-4f3a-9f1a-455b5987d303 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:03.578926 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8bd21911-ec55-4f3a-9f1a-455b5987d303 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:03.762057 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-afd76af5-e217-40fd-aadf-2aae2da361c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:03.791527 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-afd76af5-e217-40fd-aadf-2aae2da361c2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1266 microversion: 2.1 time: 0.285282 Nov 19 03:26:03.792792 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 408/885] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:03 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:03.884984 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8bd21911-ec55-4f3a-9f1a-455b5987d303 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:03.903870 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8bd21911-ec55-4f3a-9f1a-455b5987d303 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:03.905823 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8bd21911-ec55-4f3a-9f1a-455b5987d303 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:03.907914 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8bd21911-ec55-4f3a-9f1a-455b5987d303 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1407 microversion: 2.20 time: 0.350436 Nov 19 03:26:03.930504 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-b6ae7225-519a-4085-9d41-2005769cb23e req-70b8d086-5d50-48b3-9816-bbf527ff8932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d415530f-d634-4a3a-bf17-d3574e19d21f", "tag": "f37e9732-3229-47e7-8d66-8002cfe7275d"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:03.932451 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:26:03.932451 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:26:03.935780 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 478/886] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:26:03 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:26:03.942221 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-b6ae7225-519a-4085-9d41-2005769cb23e req-70b8d086-5d50-48b3-9816-bbf527ff8932 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:03.942790 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-b6ae7225-519a-4085-9d41-2005769cb23e req-70b8d086-5d50-48b3-9816-bbf527ff8932 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:03.958717 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-b6ae7225-519a-4085-9d41-2005769cb23e req-70b8d086-5d50-48b3-9816-bbf527ff8932 service nova] Creating event network-changed:f37e9732-3229-47e7-8d66-8002cfe7275d for instance d415530f-d634-4a3a-bf17-d3574e19d21f on hv-cinder-81803 Nov 19 03:26:03.965251 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-b6ae7225-519a-4085-9d41-2005769cb23e req-70b8d086-5d50-48b3-9816-bbf527ff8932 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170043 Nov 19 03:26:03.966176 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 409/887] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:26:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:26:04.809471 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-abcfcc9e-4189-4d45-a762-01369db922bf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:04.810950 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-abcfcc9e-4189-4d45-a762-01369db922bf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:04.820904 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-abcfcc9e-4189-4d45-a762-01369db922bf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:04.821796 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-abcfcc9e-4189-4d45-a762-01369db922bf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:04.822974 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-abcfcc9e-4189-4d45-a762-01369db922bf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:04.823649 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-abcfcc9e-4189-4d45-a762-01369db922bf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:04.944876 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1f9e68a1-7dec-4b40-bbd7-cd226bf488b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:04.948574 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1f9e68a1-7dec-4b40-bbd7-cd226bf488b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:04.958963 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1f9e68a1-7dec-4b40-bbd7-cd226bf488b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:04.959686 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1f9e68a1-7dec-4b40-bbd7-cd226bf488b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:04.961265 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1f9e68a1-7dec-4b40-bbd7-cd226bf488b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:04.961865 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1f9e68a1-7dec-4b40-bbd7-cd226bf488b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:04.998898 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-abcfcc9e-4189-4d45-a762-01369db922bf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:05.016519 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-abcfcc9e-4189-4d45-a762-01369db922bf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1266 microversion: 2.1 time: 0.210943 Nov 19 03:26:05.028737 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 479/888] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:04 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:05.131462 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1f9e68a1-7dec-4b40-bbd7-cd226bf488b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:05.144751 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1f9e68a1-7dec-4b40-bbd7-cd226bf488b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:05.146146 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1f9e68a1-7dec-4b40-bbd7-cd226bf488b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:05.147271 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1f9e68a1-7dec-4b40-bbd7-cd226bf488b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1407 microversion: 2.20 time: 0.216481 Nov 19 03:26:05.147827 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 410/889] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:26:04 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:26:06.034674 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-27773b30-f2ee-4684-86c6-4ccf190ee849 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:06.035287 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-27773b30-f2ee-4684-86c6-4ccf190ee849 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:06.041331 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-27773b30-f2ee-4684-86c6-4ccf190ee849 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:06.041804 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-27773b30-f2ee-4684-86c6-4ccf190ee849 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:06.042585 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-27773b30-f2ee-4684-86c6-4ccf190ee849 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:06.043025 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-27773b30-f2ee-4684-86c6-4ccf190ee849 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:06.165020 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7c8274bf-02fc-40ce-8bd3-88f4d4e1bbca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:06.165627 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7c8274bf-02fc-40ce-8bd3-88f4d4e1bbca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:06.172123 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7c8274bf-02fc-40ce-8bd3-88f4d4e1bbca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:06.172566 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7c8274bf-02fc-40ce-8bd3-88f4d4e1bbca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:06.173345 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7c8274bf-02fc-40ce-8bd3-88f4d4e1bbca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:06.173803 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7c8274bf-02fc-40ce-8bd3-88f4d4e1bbca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:06.176560 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-27773b30-f2ee-4684-86c6-4ccf190ee849 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:06.183856 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-27773b30-f2ee-4684-86c6-4ccf190ee849 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1266 microversion: 2.1 time: 0.153298 Nov 19 03:26:06.184428 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 480/890] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:06 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:06.315576 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-7c8274bf-02fc-40ce-8bd3-88f4d4e1bbca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:06.323258 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-7c8274bf-02fc-40ce-8bd3-88f4d4e1bbca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:06.324735 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-7c8274bf-02fc-40ce-8bd3-88f4d4e1bbca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:06.325825 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7c8274bf-02fc-40ce-8bd3-88f4d4e1bbca tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1407 microversion: 2.20 time: 0.164608 Nov 19 03:26:06.326380 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 411/891] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:26:06 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:26:07.201008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9a33a6d1-e1f7-4041-9224-69e79f1c72ad tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:07.201612 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9a33a6d1-e1f7-4041-9224-69e79f1c72ad tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:07.208918 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a33a6d1-e1f7-4041-9224-69e79f1c72ad tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:07.209370 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a33a6d1-e1f7-4041-9224-69e79f1c72ad tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:07.210149 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a33a6d1-e1f7-4041-9224-69e79f1c72ad tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:07.210607 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a33a6d1-e1f7-4041-9224-69e79f1c72ad tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:07.343902 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-67109258-d321-4a8e-8ad0-58a301a9ba78 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:07.344505 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-67109258-d321-4a8e-8ad0-58a301a9ba78 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:07.345282 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9a33a6d1-e1f7-4041-9224-69e79f1c72ad tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:07.351134 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-67109258-d321-4a8e-8ad0-58a301a9ba78 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:07.351839 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-67109258-d321-4a8e-8ad0-58a301a9ba78 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:07.352611 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-67109258-d321-4a8e-8ad0-58a301a9ba78 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:07.353091 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9a33a6d1-e1f7-4041-9224-69e79f1c72ad tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1266 microversion: 2.1 time: 0.155750 Nov 19 03:26:07.353221 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-67109258-d321-4a8e-8ad0-58a301a9ba78 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:07.353666 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 481/892] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:07 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:07.496749 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-67109258-d321-4a8e-8ad0-58a301a9ba78 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:07.505446 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-67109258-d321-4a8e-8ad0-58a301a9ba78 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:07.506934 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-67109258-d321-4a8e-8ad0-58a301a9ba78 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:07.508027 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-67109258-d321-4a8e-8ad0-58a301a9ba78 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1407 microversion: 2.20 time: 0.167764 Nov 19 03:26:07.508774 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 412/893] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:26:07 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:26:07.644873 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-23904427-2d40-49b1-ba70-49be05a3e979 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:07.645366 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-23904427-2d40-49b1-ba70-49be05a3e979 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:07.651348 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-23904427-2d40-49b1-ba70-49be05a3e979 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:07.651794 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-23904427-2d40-49b1-ba70-49be05a3e979 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:07.652578 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-23904427-2d40-49b1-ba70-49be05a3e979 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:07.653028 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-23904427-2d40-49b1-ba70-49be05a3e979 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:07.731564 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-23904427-2d40-49b1-ba70-49be05a3e979 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lazy-loading 'services' on Instance uuid 5741fba7-f551-445e-833f-303eca2c8dae {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:26:07.800645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-23904427-2d40-49b1-ba70-49be05a3e979 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/os-volume_attachments/465f7e9d-148b-4f82-827d-0afaabe469e5" status: 202 len: 0 microversion: 2.1 time: 0.159986 Nov 19 03:26:07.801240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 482/894] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Nov 19 03:26:07 2021] DELETE /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/os-volume_attachments/465f7e9d-148b-4f82-827d-0afaabe469e5 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:08.368993 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-079c3822-b0ad-4f6a-963a-ce405710b11e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:08.369602 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-079c3822-b0ad-4f6a-963a-ce405710b11e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:08.376100 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-079c3822-b0ad-4f6a-963a-ce405710b11e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:08.376619 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-079c3822-b0ad-4f6a-963a-ce405710b11e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:08.377496 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-079c3822-b0ad-4f6a-963a-ce405710b11e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:08.378617 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-079c3822-b0ad-4f6a-963a-ce405710b11e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:08.527781 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2392b0a0-dc9c-48f7-9400-5210d194b636 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:08.528473 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2392b0a0-dc9c-48f7-9400-5210d194b636 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:08.535997 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2392b0a0-dc9c-48f7-9400-5210d194b636 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:08.536447 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2392b0a0-dc9c-48f7-9400-5210d194b636 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:08.537242 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2392b0a0-dc9c-48f7-9400-5210d194b636 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:08.537680 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2392b0a0-dc9c-48f7-9400-5210d194b636 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:08.566881 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-079c3822-b0ad-4f6a-963a-ce405710b11e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:08.576274 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-079c3822-b0ad-4f6a-963a-ce405710b11e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1266 microversion: 2.1 time: 0.210823 Nov 19 03:26:08.576853 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 413/895] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:08 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:08.688150 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2392b0a0-dc9c-48f7-9400-5210d194b636 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:08.696105 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2392b0a0-dc9c-48f7-9400-5210d194b636 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:08.697574 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2392b0a0-dc9c-48f7-9400-5210d194b636 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:08.698702 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2392b0a0-dc9c-48f7-9400-5210d194b636 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1407 microversion: 2.20 time: 0.175647 Nov 19 03:26:08.699267 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 483/896] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:26:08 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:26:08.930900 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-defee1e3-8ab5-4f70-aa31-a70c88522736 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:08.937042 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-defee1e3-8ab5-4f70-aa31-a70c88522736 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:08.937657 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-defee1e3-8ab5-4f70-aa31-a70c88522736 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:09.014331 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-defee1e3-8ab5-4f70-aa31-a70c88522736 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Going to try to stop instance {{(pid=116066) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 19 03:26:09.081552 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-defee1e3-8ab5-4f70-aa31-a70c88522736 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 202 len: 0 microversion: 2.1 time: 0.153093 Nov 19 03:26:09.083109 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 414/897] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:26:08 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:09.092491 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-200b02c9-57fc-415e-b147-06987f5af21b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:09.093433 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-200b02c9-57fc-415e-b147-06987f5af21b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:09.104037 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-200b02c9-57fc-415e-b147-06987f5af21b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:09.104755 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-200b02c9-57fc-415e-b147-06987f5af21b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:09.105574 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-200b02c9-57fc-415e-b147-06987f5af21b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:09.106079 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-200b02c9-57fc-415e-b147-06987f5af21b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:09.209202 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-f080ad58-f24a-4042-87a2-2618ce7355e6 req-2cf1c18f-3439-45b0-b5c5-477ba8f9e7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a889deb-2a02-4c52-8e3d-a666e5cbb1ba", "name": "network-vif-plugged", "status": "completed", "tag": "7ed0f6c9-ba15-4c53-b55d-b5d4da5d47f5"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:09.210992 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:26:09.210992 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:26:09.218087 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-f080ad58-f24a-4042-87a2-2618ce7355e6 req-2cf1c18f-3439-45b0-b5c5-477ba8f9e7a5 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:09.218825 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-f080ad58-f24a-4042-87a2-2618ce7355e6 req-2cf1c18f-3439-45b0-b5c5-477ba8f9e7a5 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:09.230500 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-f080ad58-f24a-4042-87a2-2618ce7355e6 req-2cf1c18f-3439-45b0-b5c5-477ba8f9e7a5 service nova] Creating event network-vif-plugged:7ed0f6c9-ba15-4c53-b55d-b5d4da5d47f5 for instance 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba on hv-cinder-81803 Nov 19 03:26:09.235219 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-f080ad58-f24a-4042-87a2-2618ce7355e6 req-2cf1c18f-3439-45b0-b5c5-477ba8f9e7a5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264289 Nov 19 03:26:09.235807 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 484/898] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:26:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:26:09.252021 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-200b02c9-57fc-415e-b147-06987f5af21b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:09.260048 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-200b02c9-57fc-415e-b147-06987f5af21b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1677 microversion: 2.1 time: 0.172153 Nov 19 03:26:09.260622 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 415/899] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:09 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:09.594114 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a2ca76b6-5494-4e4f-94df-007cb816abcb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:09.594926 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a2ca76b6-5494-4e4f-94df-007cb816abcb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:09.601399 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a2ca76b6-5494-4e4f-94df-007cb816abcb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:09.601837 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a2ca76b6-5494-4e4f-94df-007cb816abcb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:09.602639 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a2ca76b6-5494-4e4f-94df-007cb816abcb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:09.603067 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a2ca76b6-5494-4e4f-94df-007cb816abcb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:09.716306 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c2962993-34e5-4f54-9a50-57d0a3a889b2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:09.716920 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c2962993-34e5-4f54-9a50-57d0a3a889b2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:09.724165 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c2962993-34e5-4f54-9a50-57d0a3a889b2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:09.724812 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c2962993-34e5-4f54-9a50-57d0a3a889b2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:09.725786 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c2962993-34e5-4f54-9a50-57d0a3a889b2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:09.726385 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c2962993-34e5-4f54-9a50-57d0a3a889b2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:09.745365 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a2ca76b6-5494-4e4f-94df-007cb816abcb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:09.752707 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a2ca76b6-5494-4e4f-94df-007cb816abcb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1266 microversion: 2.1 time: 0.163590 Nov 19 03:26:09.753285 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 485/900] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:09 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:09.869839 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c2962993-34e5-4f54-9a50-57d0a3a889b2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:09.878054 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c2962993-34e5-4f54-9a50-57d0a3a889b2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:09.879577 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c2962993-34e5-4f54-9a50-57d0a3a889b2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:09.880677 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c2962993-34e5-4f54-9a50-57d0a3a889b2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1407 microversion: 2.20 time: 0.168001 Nov 19 03:26:09.881415 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 416/901] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:26:09 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:26:10.278225 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-189227da-2238-486f-a9a4-1adb119087e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:10.278859 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-189227da-2238-486f-a9a4-1adb119087e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:10.284981 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-189227da-2238-486f-a9a4-1adb119087e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:10.285441 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-189227da-2238-486f-a9a4-1adb119087e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:10.286215 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-189227da-2238-486f-a9a4-1adb119087e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:10.286682 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-189227da-2238-486f-a9a4-1adb119087e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:10.420496 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-189227da-2238-486f-a9a4-1adb119087e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:10.427984 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-189227da-2238-486f-a9a4-1adb119087e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1677 microversion: 2.1 time: 0.153519 Nov 19 03:26:10.428542 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 486/902] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:10 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:10.769466 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-44a63077-3508-4c92-a458-fc19204dce2a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:10.770074 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-44a63077-3508-4c92-a458-fc19204dce2a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:10.776434 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-44a63077-3508-4c92-a458-fc19204dce2a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:10.776874 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-44a63077-3508-4c92-a458-fc19204dce2a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:10.777662 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-44a63077-3508-4c92-a458-fc19204dce2a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:10.778143 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-44a63077-3508-4c92-a458-fc19204dce2a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:10.898231 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7fd61447-cbb7-44b3-b0ef-b37a1605cb63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:10.898994 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7fd61447-cbb7-44b3-b0ef-b37a1605cb63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:10.905381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7fd61447-cbb7-44b3-b0ef-b37a1605cb63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:10.905910 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7fd61447-cbb7-44b3-b0ef-b37a1605cb63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:10.906739 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7fd61447-cbb7-44b3-b0ef-b37a1605cb63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:10.907423 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7fd61447-cbb7-44b3-b0ef-b37a1605cb63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:10.916859 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-44a63077-3508-4c92-a458-fc19204dce2a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:10.925168 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-44a63077-3508-4c92-a458-fc19204dce2a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1266 microversion: 2.1 time: 0.158959 Nov 19 03:26:10.925875 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 417/903] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:10 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:11.054500 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7fd61447-cbb7-44b3-b0ef-b37a1605cb63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:11.062327 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7fd61447-cbb7-44b3-b0ef-b37a1605cb63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:11.063833 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7fd61447-cbb7-44b3-b0ef-b37a1605cb63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:11.064933 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7fd61447-cbb7-44b3-b0ef-b37a1605cb63 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1407 microversion: 2.20 time: 0.170404 Nov 19 03:26:11.066366 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 487/904] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:26:10 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:26:11.445558 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cf5c1270-d3a8-4471-8d38-625edbf52ade tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:11.446163 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-cf5c1270-d3a8-4471-8d38-625edbf52ade tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:11.452200 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf5c1270-d3a8-4471-8d38-625edbf52ade tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:11.452642 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf5c1270-d3a8-4471-8d38-625edbf52ade tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:11.453415 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf5c1270-d3a8-4471-8d38-625edbf52ade tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:11.453843 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cf5c1270-d3a8-4471-8d38-625edbf52ade tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:11.588685 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-cf5c1270-d3a8-4471-8d38-625edbf52ade tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:11.597555 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cf5c1270-d3a8-4471-8d38-625edbf52ade tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1677 microversion: 2.1 time: 0.155775 Nov 19 03:26:11.598151 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 418/905] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:11 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:11.940961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-604f23da-5b98-4d18-bd81-1d0e72e82f1b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:11.941561 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-604f23da-5b98-4d18-bd81-1d0e72e82f1b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:11.947834 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-604f23da-5b98-4d18-bd81-1d0e72e82f1b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:11.948279 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-604f23da-5b98-4d18-bd81-1d0e72e82f1b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:11.949048 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-604f23da-5b98-4d18-bd81-1d0e72e82f1b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:11.949475 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-604f23da-5b98-4d18-bd81-1d0e72e82f1b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:12.083684 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4e0b67e5-017a-4fad-85dd-49fbd2bf2c12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:12.084352 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4e0b67e5-017a-4fad-85dd-49fbd2bf2c12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:12.090801 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e0b67e5-017a-4fad-85dd-49fbd2bf2c12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:12.091284 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e0b67e5-017a-4fad-85dd-49fbd2bf2c12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:12.092061 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e0b67e5-017a-4fad-85dd-49fbd2bf2c12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:12.092480 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e0b67e5-017a-4fad-85dd-49fbd2bf2c12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:12.094399 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-604f23da-5b98-4d18-bd81-1d0e72e82f1b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:12.102495 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-604f23da-5b98-4d18-bd81-1d0e72e82f1b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1266 microversion: 2.1 time: 0.165202 Nov 19 03:26:12.103095 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 488/906] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:11 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:12.227368 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-4e0b67e5-017a-4fad-85dd-49fbd2bf2c12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:12.235654 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-4e0b67e5-017a-4fad-85dd-49fbd2bf2c12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:12.237184 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-4e0b67e5-017a-4fad-85dd-49fbd2bf2c12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:12.238340 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4e0b67e5-017a-4fad-85dd-49fbd2bf2c12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1599 microversion: 2.20 time: 0.158873 Nov 19 03:26:12.238928 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 419/907] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:26:12 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:26:12.255397 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e5a1b1c6-277e-4301-ac9c-12abc7924075 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:12.255897 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e5a1b1c6-277e-4301-ac9c-12abc7924075 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:12.262464 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e5a1b1c6-277e-4301-ac9c-12abc7924075 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:12.262464 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e5a1b1c6-277e-4301-ac9c-12abc7924075 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:12.263104 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e5a1b1c6-277e-4301-ac9c-12abc7924075 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:12.263747 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e5a1b1c6-277e-4301-ac9c-12abc7924075 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:12.343768 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e5a1b1c6-277e-4301-ac9c-12abc7924075 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092020 Nov 19 03:26:12.344368 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 489/908] 10.222.0.47 () {60 vars in 1315 bytes} [Fri Nov 19 03:26:12 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:26:12.615887 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-794328ba-494f-4400-bccc-523e67a09e62 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:12.616511 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-794328ba-494f-4400-bccc-523e67a09e62 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:12.622201 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-794328ba-494f-4400-bccc-523e67a09e62 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:12.622686 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-794328ba-494f-4400-bccc-523e67a09e62 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:12.623453 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-794328ba-494f-4400-bccc-523e67a09e62 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:12.623880 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-794328ba-494f-4400-bccc-523e67a09e62 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:12.870665 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-794328ba-494f-4400-bccc-523e67a09e62 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:12.878555 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-794328ba-494f-4400-bccc-523e67a09e62 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1677 microversion: 2.1 time: 0.265909 Nov 19 03:26:12.879120 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 420/909] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:12 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1677 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:13.119785 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c17cc548-cc5f-40e4-b805-6165d8d217db tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:13.120398 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c17cc548-cc5f-40e4-b805-6165d8d217db tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:13.126752 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c17cc548-cc5f-40e4-b805-6165d8d217db tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:13.127203 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c17cc548-cc5f-40e4-b805-6165d8d217db tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:13.128699 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c17cc548-cc5f-40e4-b805-6165d8d217db tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:13.129138 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c17cc548-cc5f-40e4-b805-6165d8d217db tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:13.365210 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c17cc548-cc5f-40e4-b805-6165d8d217db tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:13.373520 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c17cc548-cc5f-40e4-b805-6165d8d217db tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1266 microversion: 2.1 time: 0.257799 Nov 19 03:26:13.374721 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 490/910] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:13 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:13.465510 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-10c09f3c-a03a-48a3-83eb-aa28d41bb5f5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:13.466967 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-10c09f3c-a03a-48a3-83eb-aa28d41bb5f5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:13.468639 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-eadbc29f-69ad-44ce-b9b8-689f0b0e6af9 req-c68aa7a0-3a6b-4791-8a12-eba947cfeda4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a889deb-2a02-4c52-8e3d-a666e5cbb1ba", "tag": "7ed0f6c9-ba15-4c53-b55d-b5d4da5d47f5"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:13.470431 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:26:13.470431 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:26:13.474596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-10c09f3c-a03a-48a3-83eb-aa28d41bb5f5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:13.475186 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-10c09f3c-a03a-48a3-83eb-aa28d41bb5f5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:13.476478 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-10c09f3c-a03a-48a3-83eb-aa28d41bb5f5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:13.476958 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-10c09f3c-a03a-48a3-83eb-aa28d41bb5f5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:13.479743 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-eadbc29f-69ad-44ce-b9b8-689f0b0e6af9 req-c68aa7a0-3a6b-4791-8a12-eba947cfeda4 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:13.480191 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-eadbc29f-69ad-44ce-b9b8-689f0b0e6af9 req-c68aa7a0-3a6b-4791-8a12-eba947cfeda4 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:13.493498 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-eadbc29f-69ad-44ce-b9b8-689f0b0e6af9 req-c68aa7a0-3a6b-4791-8a12-eba947cfeda4 service nova] Creating event network-changed:7ed0f6c9-ba15-4c53-b55d-b5d4da5d47f5 for instance 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba on hv-cinder-81803 Nov 19 03:26:13.498997 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-eadbc29f-69ad-44ce-b9b8-689f0b0e6af9 req-c68aa7a0-3a6b-4791-8a12-eba947cfeda4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033382 Nov 19 03:26:13.499533 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 491/911] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:26:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:26:13.600576 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-10c09f3c-a03a-48a3-83eb-aa28d41bb5f5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 14 microversion: 2.20 time: 0.139007 Nov 19 03:26:13.601427 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 421/912] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:13 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:13.896317 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1540c23c-6529-4726-8e51-4dd8862dfc41 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:13.897691 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1540c23c-6529-4726-8e51-4dd8862dfc41 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:13.904668 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1540c23c-6529-4726-8e51-4dd8862dfc41 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:13.905341 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1540c23c-6529-4726-8e51-4dd8862dfc41 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:13.906144 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1540c23c-6529-4726-8e51-4dd8862dfc41 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:13.906705 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1540c23c-6529-4726-8e51-4dd8862dfc41 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:14.050370 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-1540c23c-6529-4726-8e51-4dd8862dfc41 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:14.058371 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1540c23c-6529-4726-8e51-4dd8862dfc41 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1677 microversion: 2.1 time: 0.166028 Nov 19 03:26:14.059721 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 492/913] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:13 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:14.390670 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b6cb2242-58bf-4960-93b1-53c43fbd23a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:14.391366 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b6cb2242-58bf-4960-93b1-53c43fbd23a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:14.399300 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b6cb2242-58bf-4960-93b1-53c43fbd23a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:14.399754 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b6cb2242-58bf-4960-93b1-53c43fbd23a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:14.400547 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b6cb2242-58bf-4960-93b1-53c43fbd23a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:14.400983 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b6cb2242-58bf-4960-93b1-53c43fbd23a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:14.544730 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b6cb2242-58bf-4960-93b1-53c43fbd23a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:14.552928 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b6cb2242-58bf-4960-93b1-53c43fbd23a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1266 microversion: 2.1 time: 0.166228 Nov 19 03:26:14.553503 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 422/914] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:14 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:14.611524 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c219471c-1572-4b8e-bcc2-6c15f62d981e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:14.612629 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c219471c-1572-4b8e-bcc2-6c15f62d981e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:14.619123 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c219471c-1572-4b8e-bcc2-6c15f62d981e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:14.619835 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c219471c-1572-4b8e-bcc2-6c15f62d981e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:14.620616 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c219471c-1572-4b8e-bcc2-6c15f62d981e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:14.621050 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c219471c-1572-4b8e-bcc2-6c15f62d981e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:14.711988 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c219471c-1572-4b8e-bcc2-6c15f62d981e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 14 microversion: 2.20 time: 0.103904 Nov 19 03:26:14.715093 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 493/915] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:14 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:15.079729 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-73981878-a2a1-4a34-9225-a1dd46de0fdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:15.080586 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-73981878-a2a1-4a34-9225-a1dd46de0fdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:15.088443 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73981878-a2a1-4a34-9225-a1dd46de0fdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:15.088975 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73981878-a2a1-4a34-9225-a1dd46de0fdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:15.089824 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73981878-a2a1-4a34-9225-a1dd46de0fdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:15.090352 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-73981878-a2a1-4a34-9225-a1dd46de0fdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:15.224687 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-73981878-a2a1-4a34-9225-a1dd46de0fdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:15.232110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-73981878-a2a1-4a34-9225-a1dd46de0fdd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1677 microversion: 2.1 time: 0.160378 Nov 19 03:26:15.232689 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 423/916] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:15 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:15.571034 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2a47950d-564b-4947-962e-58682bd2b2ac tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:15.571721 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2a47950d-564b-4947-962e-58682bd2b2ac tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:15.579405 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2a47950d-564b-4947-962e-58682bd2b2ac tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:15.579851 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2a47950d-564b-4947-962e-58682bd2b2ac tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:15.580659 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2a47950d-564b-4947-962e-58682bd2b2ac tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:15.581086 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2a47950d-564b-4947-962e-58682bd2b2ac tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:15.717389 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2a47950d-564b-4947-962e-58682bd2b2ac tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:15.723293 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3499769e-7882-41ac-86ad-23267821fe7d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:15.724864 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3499769e-7882-41ac-86ad-23267821fe7d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:15.727672 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2a47950d-564b-4947-962e-58682bd2b2ac tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1266 microversion: 2.1 time: 0.161383 Nov 19 03:26:15.728272 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 494/917] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:15 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:15.731348 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3499769e-7882-41ac-86ad-23267821fe7d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:15.731802 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3499769e-7882-41ac-86ad-23267821fe7d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:15.732586 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3499769e-7882-41ac-86ad-23267821fe7d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:15.733012 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3499769e-7882-41ac-86ad-23267821fe7d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:15.823917 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3499769e-7882-41ac-86ad-23267821fe7d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 14 microversion: 2.20 time: 0.104609 Nov 19 03:26:15.825055 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 424/918] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:15 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:26:16.249472 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a686b316-5a84-4b45-aae5-c120d4e770be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:16.250170 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a686b316-5a84-4b45-aae5-c120d4e770be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:16.257145 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a686b316-5a84-4b45-aae5-c120d4e770be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:16.257591 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a686b316-5a84-4b45-aae5-c120d4e770be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:16.258660 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a686b316-5a84-4b45-aae5-c120d4e770be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:16.259093 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a686b316-5a84-4b45-aae5-c120d4e770be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:16.390318 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a686b316-5a84-4b45-aae5-c120d4e770be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:16.399732 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a686b316-5a84-4b45-aae5-c120d4e770be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1677 microversion: 2.1 time: 0.153836 Nov 19 03:26:16.400327 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 495/919] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:16 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:16.744718 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6ebbbd6f-9c3c-4592-bc6e-1f2f9fac8ba9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:16.745408 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6ebbbd6f-9c3c-4592-bc6e-1f2f9fac8ba9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:16.752239 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ebbbd6f-9c3c-4592-bc6e-1f2f9fac8ba9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:16.753330 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ebbbd6f-9c3c-4592-bc6e-1f2f9fac8ba9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:16.754107 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ebbbd6f-9c3c-4592-bc6e-1f2f9fac8ba9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:16.754568 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ebbbd6f-9c3c-4592-bc6e-1f2f9fac8ba9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:16.834446 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-cad1b70f-eaf6-4a20-99fd-2a95260c1aa2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:16.835734 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-cad1b70f-eaf6-4a20-99fd-2a95260c1aa2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:16.844113 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cad1b70f-eaf6-4a20-99fd-2a95260c1aa2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:16.844756 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cad1b70f-eaf6-4a20-99fd-2a95260c1aa2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:16.845579 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cad1b70f-eaf6-4a20-99fd-2a95260c1aa2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:16.846023 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cad1b70f-eaf6-4a20-99fd-2a95260c1aa2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:16.898628 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-6ebbbd6f-9c3c-4592-bc6e-1f2f9fac8ba9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:16.905835 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6ebbbd6f-9c3c-4592-bc6e-1f2f9fac8ba9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1266 microversion: 2.1 time: 0.165195 Nov 19 03:26:16.906391 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 425/920] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:16 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:16.933345 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-cad1b70f-eaf6-4a20-99fd-2a95260c1aa2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 14 microversion: 2.20 time: 0.102350 Nov 19 03:26:16.933973 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 496/921] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:16 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:26:17.014528 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-818f670b-8f16-47a1-8f5d-467682252dba req-441bf97c-aca0-4d0d-9ff0-22cbfd923956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d415530f-d634-4a3a-bf17-d3574e19d21f", "name": "network-vif-plugged", "status": "completed", "tag": "f37e9732-3229-47e7-8d66-8002cfe7275d"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:17.016045 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:26:17.016045 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:26:17.023994 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-818f670b-8f16-47a1-8f5d-467682252dba req-441bf97c-aca0-4d0d-9ff0-22cbfd923956 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:17.024493 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-818f670b-8f16-47a1-8f5d-467682252dba req-441bf97c-aca0-4d0d-9ff0-22cbfd923956 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:17.037320 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-818f670b-8f16-47a1-8f5d-467682252dba req-441bf97c-aca0-4d0d-9ff0-22cbfd923956 service nova] Creating event network-vif-plugged:f37e9732-3229-47e7-8d66-8002cfe7275d for instance d415530f-d634-4a3a-bf17-d3574e19d21f on hv-cinder-81803 Nov 19 03:26:17.042162 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-818f670b-8f16-47a1-8f5d-467682252dba req-441bf97c-aca0-4d0d-9ff0-22cbfd923956 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032336 Nov 19 03:26:17.043041 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 426/922] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:26:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:26:17.417444 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d01607ce-0a61-424c-a9e2-0899d04d7993 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:17.418132 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d01607ce-0a61-424c-a9e2-0899d04d7993 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:17.425102 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d01607ce-0a61-424c-a9e2-0899d04d7993 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:17.425540 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d01607ce-0a61-424c-a9e2-0899d04d7993 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:17.426309 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d01607ce-0a61-424c-a9e2-0899d04d7993 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:17.426834 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d01607ce-0a61-424c-a9e2-0899d04d7993 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:17.559516 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d01607ce-0a61-424c-a9e2-0899d04d7993 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:17.567168 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d01607ce-0a61-424c-a9e2-0899d04d7993 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1677 microversion: 2.1 time: 0.153611 Nov 19 03:26:17.567830 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 497/923] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:17 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:17.924004 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8e872dae-9609-4854-b5ea-61879ac2ef69 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:17.926170 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8e872dae-9609-4854-b5ea-61879ac2ef69 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:17.931389 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e872dae-9609-4854-b5ea-61879ac2ef69 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:17.931823 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e872dae-9609-4854-b5ea-61879ac2ef69 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:17.932722 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e872dae-9609-4854-b5ea-61879ac2ef69 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:17.933154 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e872dae-9609-4854-b5ea-61879ac2ef69 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:17.944694 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-64e25549-7298-4b26-9925-27cfdebf2745 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:17.945724 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-64e25549-7298-4b26-9925-27cfdebf2745 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:17.951906 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-64e25549-7298-4b26-9925-27cfdebf2745 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:17.952349 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-64e25549-7298-4b26-9925-27cfdebf2745 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:17.953112 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-64e25549-7298-4b26-9925-27cfdebf2745 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:17.953539 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-64e25549-7298-4b26-9925-27cfdebf2745 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:18.072586 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8e872dae-9609-4854-b5ea-61879ac2ef69 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:18.080022 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8e872dae-9609-4854-b5ea-61879ac2ef69 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1266 microversion: 2.1 time: 0.160029 Nov 19 03:26:18.080587 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 427/924] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:17 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:18.147862 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-64e25549-7298-4b26-9925-27cfdebf2745 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 14 microversion: 2.20 time: 0.207063 Nov 19 03:26:18.148580 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 498/925] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:17 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:18.583755 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c583ecb8-1a2f-4981-a0c8-0643ad43d9d8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:18.584350 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c583ecb8-1a2f-4981-a0c8-0643ad43d9d8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:18.590617 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c583ecb8-1a2f-4981-a0c8-0643ad43d9d8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:18.591055 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c583ecb8-1a2f-4981-a0c8-0643ad43d9d8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:18.591813 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c583ecb8-1a2f-4981-a0c8-0643ad43d9d8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:18.592236 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c583ecb8-1a2f-4981-a0c8-0643ad43d9d8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:18.729271 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c583ecb8-1a2f-4981-a0c8-0643ad43d9d8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:18.736774 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c583ecb8-1a2f-4981-a0c8-0643ad43d9d8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1677 microversion: 2.1 time: 0.156621 Nov 19 03:26:18.737910 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 428/926] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:18 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:19.097653 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c5e727df-823a-40bc-95fe-a9aaa1a00d87 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:19.098342 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c5e727df-823a-40bc-95fe-a9aaa1a00d87 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:19.105529 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c5e727df-823a-40bc-95fe-a9aaa1a00d87 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:19.106011 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c5e727df-823a-40bc-95fe-a9aaa1a00d87 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:19.106819 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c5e727df-823a-40bc-95fe-a9aaa1a00d87 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:19.108166 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c5e727df-823a-40bc-95fe-a9aaa1a00d87 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:19.159628 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-38ea1bf6-6535-40a5-8b58-33e6661f1788 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:19.160631 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-38ea1bf6-6535-40a5-8b58-33e6661f1788 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:19.166432 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-38ea1bf6-6535-40a5-8b58-33e6661f1788 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:19.166913 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-38ea1bf6-6535-40a5-8b58-33e6661f1788 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:19.167686 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-38ea1bf6-6535-40a5-8b58-33e6661f1788 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:19.168119 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-38ea1bf6-6535-40a5-8b58-33e6661f1788 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:19.247630 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c5e727df-823a-40bc-95fe-a9aaa1a00d87 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:19.255620 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c5e727df-823a-40bc-95fe-a9aaa1a00d87 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1452 microversion: 2.1 time: 0.162557 Nov 19 03:26:19.256185 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 499/927] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:19 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:19.259938 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-38ea1bf6-6535-40a5-8b58-33e6661f1788 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 14 microversion: 2.20 time: 0.104338 Nov 19 03:26:19.260653 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 429/928] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:19 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:26:19.272813 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-94c18ec5-3ac9-40fb-9384-5ed902b78974 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:19.273425 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-94c18ec5-3ac9-40fb-9384-5ed902b78974 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:19.279489 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-94c18ec5-3ac9-40fb-9384-5ed902b78974 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:19.279955 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-94c18ec5-3ac9-40fb-9384-5ed902b78974 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:19.280708 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-94c18ec5-3ac9-40fb-9384-5ed902b78974 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:19.281140 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-94c18ec5-3ac9-40fb-9384-5ed902b78974 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:19.420664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-94c18ec5-3ac9-40fb-9384-5ed902b78974 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:19.428472 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-94c18ec5-3ac9-40fb-9384-5ed902b78974 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1452 microversion: 2.1 time: 0.160954 Nov 19 03:26:19.429040 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 500/929] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:19 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:19.756538 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0196d11f-485c-446b-b679-485a20087239 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:19.757269 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0196d11f-485c-446b-b679-485a20087239 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:19.764468 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0196d11f-485c-446b-b679-485a20087239 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:19.764907 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0196d11f-485c-446b-b679-485a20087239 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:19.765684 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0196d11f-485c-446b-b679-485a20087239 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:19.766144 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0196d11f-485c-446b-b679-485a20087239 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:20.243201 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0196d11f-485c-446b-b679-485a20087239 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:20.250400 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0196d11f-485c-446b-b679-485a20087239 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1654 microversion: 2.1 time: 0.498640 Nov 19 03:26:20.251733 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 430/930] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:19 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1654 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:26:20.266785 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-982ba453-baf0-42c2-9d98-bf0e89152ecc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:20.270506 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a3285406-e9a7-44b7-aab6-65f7f206c6c4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:20.271615 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a3285406-e9a7-44b7-aab6-65f7f206c6c4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:20.276237 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-982ba453-baf0-42c2-9d98-bf0e89152ecc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:20.276913 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-982ba453-baf0-42c2-9d98-bf0e89152ecc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:20.278413 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a3285406-e9a7-44b7-aab6-65f7f206c6c4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:20.279339 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a3285406-e9a7-44b7-aab6-65f7f206c6c4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:20.280133 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a3285406-e9a7-44b7-aab6-65f7f206c6c4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:20.281236 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a3285406-e9a7-44b7-aab6-65f7f206c6c4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:20.301222 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-982ba453-baf0-42c2-9d98-bf0e89152ecc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Going to try to start instance {{(pid=116065) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 19 03:26:20.347986 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-982ba453-baf0-42c2-9d98-bf0e89152ecc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action" status: 202 len: 0 microversion: 2.1 time: 0.084685 Nov 19 03:26:20.348680 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 501/931] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:26:20 2021] POST /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:20.357641 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5caec80a-d66a-43d2-8b06-c0525c33c573 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:20.358346 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5caec80a-d66a-43d2-8b06-c0525c33c573 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:20.364755 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5caec80a-d66a-43d2-8b06-c0525c33c573 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:20.365324 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5caec80a-d66a-43d2-8b06-c0525c33c573 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:20.366100 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5caec80a-d66a-43d2-8b06-c0525c33c573 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:20.366617 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5caec80a-d66a-43d2-8b06-c0525c33c573 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:20.382124 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a3285406-e9a7-44b7-aab6-65f7f206c6c4 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 14 microversion: 2.20 time: 0.115947 Nov 19 03:26:20.382876 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 431/932] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:20 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:20.640735 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5caec80a-d66a-43d2-8b06-c0525c33c573 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:20.649606 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5caec80a-d66a-43d2-8b06-c0525c33c573 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1663 microversion: 2.1 time: 0.295765 Nov 19 03:26:20.650339 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 502/933] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:20 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1663 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:21.393939 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-046e531b-62ce-4a3e-b0a4-764f82747110 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:21.394933 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-046e531b-62ce-4a3e-b0a4-764f82747110 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:21.401738 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-046e531b-62ce-4a3e-b0a4-764f82747110 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:21.402188 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-046e531b-62ce-4a3e-b0a4-764f82747110 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:21.403023 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-046e531b-62ce-4a3e-b0a4-764f82747110 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:21.403428 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-046e531b-62ce-4a3e-b0a4-764f82747110 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:21.548941 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-046e531b-62ce-4a3e-b0a4-764f82747110 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 14 microversion: 2.20 time: 0.159078 Nov 19 03:26:21.552870 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 432/934] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:21 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:21.667578 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a06d8808-9011-4240-b293-c15a2f6c15ae tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:21.668377 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a06d8808-9011-4240-b293-c15a2f6c15ae tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:21.675978 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a06d8808-9011-4240-b293-c15a2f6c15ae tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:21.676740 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a06d8808-9011-4240-b293-c15a2f6c15ae tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:21.677724 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a06d8808-9011-4240-b293-c15a2f6c15ae tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:21.678168 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a06d8808-9011-4240-b293-c15a2f6c15ae tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:21.704983 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-21c0249a-37ec-4745-b078-6aaf770630ee req-50b2c27b-74c5-4ddc-a5b3-c0266674052b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d415530f-d634-4a3a-bf17-d3574e19d21f", "tag": "f37e9732-3229-47e7-8d66-8002cfe7275d"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:21.706598 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:26:21.706598 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:26:21.716697 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-21c0249a-37ec-4745-b078-6aaf770630ee req-50b2c27b-74c5-4ddc-a5b3-c0266674052b service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:21.717147 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-21c0249a-37ec-4745-b078-6aaf770630ee req-50b2c27b-74c5-4ddc-a5b3-c0266674052b service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:21.731717 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-21c0249a-37ec-4745-b078-6aaf770630ee req-50b2c27b-74c5-4ddc-a5b3-c0266674052b service nova] Creating event network-changed:f37e9732-3229-47e7-8d66-8002cfe7275d for instance d415530f-d634-4a3a-bf17-d3574e19d21f on hv-cinder-81803 Nov 19 03:26:21.739790 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-21c0249a-37ec-4745-b078-6aaf770630ee req-50b2c27b-74c5-4ddc-a5b3-c0266674052b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045568 Nov 19 03:26:21.740753 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 433/935] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:26:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:26:21.840029 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a06d8808-9011-4240-b293-c15a2f6c15ae tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:21.848176 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a06d8808-9011-4240-b293-c15a2f6c15ae tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1663 microversion: 2.1 time: 0.184193 Nov 19 03:26:21.858495 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 503/936] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:21 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1663 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:22.561176 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-868df80d-b0b9-4328-bcdf-d20d7ed3f344 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:22.562171 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-868df80d-b0b9-4328-bcdf-d20d7ed3f344 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:22.568445 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-868df80d-b0b9-4328-bcdf-d20d7ed3f344 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:22.568893 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-868df80d-b0b9-4328-bcdf-d20d7ed3f344 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:22.569668 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-868df80d-b0b9-4328-bcdf-d20d7ed3f344 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:22.570105 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-868df80d-b0b9-4328-bcdf-d20d7ed3f344 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:22.659246 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-868df80d-b0b9-4328-bcdf-d20d7ed3f344 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 14 microversion: 2.20 time: 0.101986 Nov 19 03:26:22.659982 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 434/937] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:22 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:22.866492 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c80902fe-02f2-4130-a003-b4d890f3badb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:22.867109 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c80902fe-02f2-4130-a003-b4d890f3badb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:22.873429 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c80902fe-02f2-4130-a003-b4d890f3badb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:22.873873 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c80902fe-02f2-4130-a003-b4d890f3badb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:22.874684 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c80902fe-02f2-4130-a003-b4d890f3badb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:22.875114 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c80902fe-02f2-4130-a003-b4d890f3badb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:23.004885 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c80902fe-02f2-4130-a003-b4d890f3badb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:23.012131 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c80902fe-02f2-4130-a003-b4d890f3badb tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1667 microversion: 2.1 time: 0.149986 Nov 19 03:26:23.012700 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 504/938] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:22 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:23.670215 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-98dff679-9d46-4b14-908c-ea3a73e7240b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:23.671239 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-98dff679-9d46-4b14-908c-ea3a73e7240b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:23.678596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98dff679-9d46-4b14-908c-ea3a73e7240b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:23.679042 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98dff679-9d46-4b14-908c-ea3a73e7240b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:23.679858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98dff679-9d46-4b14-908c-ea3a73e7240b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:23.680285 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-98dff679-9d46-4b14-908c-ea3a73e7240b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:23.782010 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-98dff679-9d46-4b14-908c-ea3a73e7240b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 14 microversion: 2.20 time: 0.115572 Nov 19 03:26:23.783129 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 435/939] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:23 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:24.793041 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-75f54df8-2b27-471e-86c0-a4a275b4ac21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:24.793952 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-75f54df8-2b27-471e-86c0-a4a275b4ac21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:24.800674 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-75f54df8-2b27-471e-86c0-a4a275b4ac21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:24.801121 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-75f54df8-2b27-471e-86c0-a4a275b4ac21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:24.801889 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-75f54df8-2b27-471e-86c0-a4a275b4ac21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:24.802323 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-75f54df8-2b27-471e-86c0-a4a275b4ac21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:24.923053 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-75f54df8-2b27-471e-86c0-a4a275b4ac21 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 14 microversion: 2.20 time: 0.133493 Nov 19 03:26:24.923688 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 505/940] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:24 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:25.933506 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-06acc080-7555-4b1d-bcd3-4dc53c1d3260 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:25.934540 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-06acc080-7555-4b1d-bcd3-4dc53c1d3260 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:25.944078 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-06acc080-7555-4b1d-bcd3-4dc53c1d3260 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:25.944528 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-06acc080-7555-4b1d-bcd3-4dc53c1d3260 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:25.945308 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-06acc080-7555-4b1d-bcd3-4dc53c1d3260 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:25.945745 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-06acc080-7555-4b1d-bcd3-4dc53c1d3260 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:26.059965 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-06acc080-7555-4b1d-bcd3-4dc53c1d3260 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 4447 microversion: 2.20 time: 0.130160 Nov 19 03:26:26.060720 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 436/941] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:25 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 4447 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:26:27.071628 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5751286f-53aa-4e6c-bc06-c12ea988420f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:27.072750 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5751286f-53aa-4e6c-bc06-c12ea988420f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:27.079558 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5751286f-53aa-4e6c-bc06-c12ea988420f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:27.080000 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5751286f-53aa-4e6c-bc06-c12ea988420f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:27.081368 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5751286f-53aa-4e6c-bc06-c12ea988420f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:27.081928 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5751286f-53aa-4e6c-bc06-c12ea988420f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:27.187845 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5751286f-53aa-4e6c-bc06-c12ea988420f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 12498 microversion: 2.20 time: 0.119951 Nov 19 03:26:27.188399 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 506/942] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:27 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 12498 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:28.199777 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8ecdbc78-4b2e-4455-a213-b3f76be3bd5c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:28.200775 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8ecdbc78-4b2e-4455-a213-b3f76be3bd5c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:28.207647 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8ecdbc78-4b2e-4455-a213-b3f76be3bd5c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:28.208099 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8ecdbc78-4b2e-4455-a213-b3f76be3bd5c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:28.208877 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8ecdbc78-4b2e-4455-a213-b3f76be3bd5c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:28.209311 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8ecdbc78-4b2e-4455-a213-b3f76be3bd5c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:28.322205 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8ecdbc78-4b2e-4455-a213-b3f76be3bd5c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 18305 microversion: 2.20 time: 0.126543 Nov 19 03:26:28.322891 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 437/943] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:28 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 18305 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:29.334748 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-55db06af-db8e-43c9-80e7-1706658a86b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:29.335771 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-55db06af-db8e-43c9-80e7-1706658a86b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:29.342617 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-55db06af-db8e-43c9-80e7-1706658a86b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:29.343073 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-55db06af-db8e-43c9-80e7-1706658a86b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:29.343842 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-55db06af-db8e-43c9-80e7-1706658a86b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:29.344273 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-55db06af-db8e-43c9-80e7-1706658a86b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:29.462266 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-55db06af-db8e-43c9-80e7-1706658a86b6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 19133 microversion: 2.20 time: 0.131823 Nov 19 03:26:29.462911 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 507/944] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:29 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 19133 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:30.474213 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c6adeb2b-ce26-4026-8979-99b0b644daa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:30.475223 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c6adeb2b-ce26-4026-8979-99b0b644daa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:30.483054 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c6adeb2b-ce26-4026-8979-99b0b644daa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:30.483495 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c6adeb2b-ce26-4026-8979-99b0b644daa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:30.484255 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c6adeb2b-ce26-4026-8979-99b0b644daa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:30.484679 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c6adeb2b-ce26-4026-8979-99b0b644daa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:30.612412 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c6adeb2b-ce26-4026-8979-99b0b644daa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 21790 microversion: 2.20 time: 0.142133 Nov 19 03:26:30.613280 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 438/945] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:30 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 21790 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:31.624487 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c48e613d-4e8d-4ec0-90e2-565a3fec2dc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:31.625485 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c48e613d-4e8d-4ec0-90e2-565a3fec2dc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:31.632420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c48e613d-4e8d-4ec0-90e2-565a3fec2dc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:31.632886 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c48e613d-4e8d-4ec0-90e2-565a3fec2dc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:31.633645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c48e613d-4e8d-4ec0-90e2-565a3fec2dc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:31.634081 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c48e613d-4e8d-4ec0-90e2-565a3fec2dc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:31.743925 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c48e613d-4e8d-4ec0-90e2-565a3fec2dc7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 23228 microversion: 2.20 time: 0.123327 Nov 19 03:26:31.744598 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 508/946] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:31 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 23228 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:32.756583 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d2c92eb6-5bd8-43ba-a040-2789d85fe910 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:32.757572 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d2c92eb6-5bd8-43ba-a040-2789d85fe910 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:32.764481 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d2c92eb6-5bd8-43ba-a040-2789d85fe910 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:32.764950 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d2c92eb6-5bd8-43ba-a040-2789d85fe910 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:32.765717 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d2c92eb6-5bd8-43ba-a040-2789d85fe910 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:32.766149 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d2c92eb6-5bd8-43ba-a040-2789d85fe910 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:32.866181 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d2c92eb6-5bd8-43ba-a040-2789d85fe910 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 23804 microversion: 2.20 time: 0.114046 Nov 19 03:26:32.866852 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 439/947] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:32 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 23804 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:33.879301 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1df881fd-627b-4efc-b271-4c7d0fea8123 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:33.880343 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1df881fd-627b-4efc-b271-4c7d0fea8123 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:33.887281 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1df881fd-627b-4efc-b271-4c7d0fea8123 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:33.887748 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1df881fd-627b-4efc-b271-4c7d0fea8123 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:33.888643 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1df881fd-627b-4efc-b271-4c7d0fea8123 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:33.889130 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1df881fd-627b-4efc-b271-4c7d0fea8123 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:34.002449 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1df881fd-627b-4efc-b271-4c7d0fea8123 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 24928 microversion: 2.20 time: 0.127922 Nov 19 03:26:34.003858 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 509/948] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:33 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 24928 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:34.010174 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ca0d086c-8a40-4f9b-a29e-bf2ad1a01557 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1932230399"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:34.010847 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ca0d086c-8a40-4f9b-a29e-bf2ad1a01557 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:34.017645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ca0d086c-8a40-4f9b-a29e-bf2ad1a01557 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:34.018088 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ca0d086c-8a40-4f9b-a29e-bf2ad1a01557 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:34.018874 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ca0d086c-8a40-4f9b-a29e-bf2ad1a01557 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:34.019881 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ca0d086c-8a40-4f9b-a29e-bf2ad1a01557 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:34.154071 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.network.security_group_api [None req-ca0d086c-8a40-4f9b-a29e-bf2ad1a01557 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Removing security group 9598f72b-c6c1-440d-a3d9-1474d29d38f6 from port 4ad10a71-4d53-4076-951d-e0ce7c2cbf68 Nov 19 03:26:34.495798 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ca0d086c-8a40-4f9b-a29e-bf2ad1a01557 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "POST /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/action" status: 202 len: 0 microversion: 2.1 time: 0.489680 Nov 19 03:26:34.501134 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 440/949] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:26:34 2021] POST /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:34.513313 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-50dc77bb-15fe-4600-a33f-7c84651f1a6e req-3ff21081-b5b7-4665-8e36-b059cbc24683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140090bc-aacf-4ff7-8c49-35408b97f6f8", "tag": "4ad10a71-4d53-4076-951d-e0ce7c2cbf68"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:34.522751 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:26:34.522751 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:26:34.553966 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-50dc77bb-15fe-4600-a33f-7c84651f1a6e req-3ff21081-b5b7-4665-8e36-b059cbc24683 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:34.559127 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-50dc77bb-15fe-4600-a33f-7c84651f1a6e req-3ff21081-b5b7-4665-8e36-b059cbc24683 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:34.575104 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-50dc77bb-15fe-4600-a33f-7c84651f1a6e req-3ff21081-b5b7-4665-8e36-b059cbc24683 service nova] Creating event network-changed:4ad10a71-4d53-4076-951d-e0ce7c2cbf68 for instance 140090bc-aacf-4ff7-8c49-35408b97f6f8 on hv-cinder-81803 Nov 19 03:26:34.579943 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-50dc77bb-15fe-4600-a33f-7c84651f1a6e req-3ff21081-b5b7-4665-8e36-b059cbc24683 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070866 Nov 19 03:26:34.584229 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 510/950] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:26:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:26:35.014245 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-585f9687-f01d-48b8-b557-18640f7d218d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:35.015918 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-585f9687-f01d-48b8-b557-18640f7d218d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:35.027746 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-585f9687-f01d-48b8-b557-18640f7d218d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:35.028535 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-585f9687-f01d-48b8-b557-18640f7d218d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:35.029523 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-585f9687-f01d-48b8-b557-18640f7d218d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:35.030509 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-585f9687-f01d-48b8-b557-18640f7d218d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:35.135414 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-585f9687-f01d-48b8-b557-18640f7d218d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 26066 microversion: 2.20 time: 0.124541 Nov 19 03:26:35.136373 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 441/951] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:35 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 26066 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:35.705394 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-aba314c3-c405-4634-8ffb-fbbbaf6a9f67 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:35.705968 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-aba314c3-c405-4634-8ffb-fbbbaf6a9f67 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:35.712718 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-aba314c3-c405-4634-8ffb-fbbbaf6a9f67 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:35.713161 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-aba314c3-c405-4634-8ffb-fbbbaf6a9f67 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:35.713925 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-aba314c3-c405-4634-8ffb-fbbbaf6a9f67 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:35.714355 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-aba314c3-c405-4634-8ffb-fbbbaf6a9f67 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:35.800105 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-aba314c3-c405-4634-8ffb-fbbbaf6a9f67 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lazy-loading 'services' on Instance uuid 140090bc-aacf-4ff7-8c49-35408b97f6f8 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:26:35.872275 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-aba314c3-c405-4634-8ffb-fbbbaf6a9f67 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "DELETE /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments/02a2ed31-73ce-42a6-b7a4-4a0bff8182f8" status: 202 len: 0 microversion: 2.1 time: 0.171188 Nov 19 03:26:35.872874 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 511/952] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Nov 19 03:26:35 2021] DELETE /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments/02a2ed31-73ce-42a6-b7a4-4a0bff8182f8 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:35.881486 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-de5e2cc4-9ba2-4927-b4d9-1440a256e6c0 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:35.882895 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-de5e2cc4-9ba2-4927-b4d9-1440a256e6c0 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:35.904449 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-de5e2cc4-9ba2-4927-b4d9-1440a256e6c0 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:35.904904 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-de5e2cc4-9ba2-4927-b4d9-1440a256e6c0 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:35.905709 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-de5e2cc4-9ba2-4927-b4d9-1440a256e6c0 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:35.906141 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-de5e2cc4-9ba2-4927-b4d9-1440a256e6c0 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:35.936743 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-de5e2cc4-9ba2-4927-b4d9-1440a256e6c0 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059374 Nov 19 03:26:35.937307 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 442/953] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:26:35 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:26:36.148761 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-728e152f-31e0-4513-903b-d42174f28b98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:36.149803 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-728e152f-31e0-4513-903b-d42174f28b98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:36.156441 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-728e152f-31e0-4513-903b-d42174f28b98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:36.156880 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-728e152f-31e0-4513-903b-d42174f28b98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:36.157646 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-728e152f-31e0-4513-903b-d42174f28b98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:36.158077 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-728e152f-31e0-4513-903b-d42174f28b98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:36.595606 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-8ffedfcb-df7a-4c7e-861f-35ef3403267f req-dc470c13-e22d-48c0-8b68-6627121ad6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140090bc-aacf-4ff7-8c49-35408b97f6f8", "tag": "4ad10a71-4d53-4076-951d-e0ce7c2cbf68"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:36.597194 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:26:36.597194 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:26:36.604803 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-8ffedfcb-df7a-4c7e-861f-35ef3403267f req-dc470c13-e22d-48c0-8b68-6627121ad6ef service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:36.605323 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-8ffedfcb-df7a-4c7e-861f-35ef3403267f req-dc470c13-e22d-48c0-8b68-6627121ad6ef service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:36.617717 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-8ffedfcb-df7a-4c7e-861f-35ef3403267f req-dc470c13-e22d-48c0-8b68-6627121ad6ef service nova] Creating event network-changed:4ad10a71-4d53-4076-951d-e0ce7c2cbf68 for instance 140090bc-aacf-4ff7-8c49-35408b97f6f8 on hv-cinder-81803 Nov 19 03:26:36.622650 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-8ffedfcb-df7a-4c7e-861f-35ef3403267f req-dc470c13-e22d-48c0-8b68-6627121ad6ef service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030665 Nov 19 03:26:36.623249 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 443/954] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:26:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:26:36.948821 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-88e649a5-e4ab-4ccf-a1e7-f41511fdc92e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:36.949795 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-88e649a5-e4ab-4ccf-a1e7-f41511fdc92e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:36.956271 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-88e649a5-e4ab-4ccf-a1e7-f41511fdc92e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:36.957386 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-88e649a5-e4ab-4ccf-a1e7-f41511fdc92e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:36.958296 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-88e649a5-e4ab-4ccf-a1e7-f41511fdc92e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:36.958774 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-88e649a5-e4ab-4ccf-a1e7-f41511fdc92e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:36.986596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-88e649a5-e4ab-4ccf-a1e7-f41511fdc92e tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041815 Nov 19 03:26:36.987225 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 444/955] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:26:36 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:26:37.998070 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2b4f7ac8-b064-42be-a898-7d8014268d21 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:37.998945 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2b4f7ac8-b064-42be-a898-7d8014268d21 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:38.005566 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2b4f7ac8-b064-42be-a898-7d8014268d21 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:38.006004 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2b4f7ac8-b064-42be-a898-7d8014268d21 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:38.006794 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2b4f7ac8-b064-42be-a898-7d8014268d21 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:38.007219 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2b4f7ac8-b064-42be-a898-7d8014268d21 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:38.035950 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2b4f7ac8-b064-42be-a898-7d8014268d21 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041004 Nov 19 03:26:38.036485 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 445/956] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:26:37 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:26:39.048249 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1caaf892-7144-45f0-aa20-8ddf93454ec9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:39.049078 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1caaf892-7144-45f0-aa20-8ddf93454ec9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:39.055808 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1caaf892-7144-45f0-aa20-8ddf93454ec9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:39.056255 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1caaf892-7144-45f0-aa20-8ddf93454ec9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:39.057050 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1caaf892-7144-45f0-aa20-8ddf93454ec9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:39.057483 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1caaf892-7144-45f0-aa20-8ddf93454ec9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:39.086119 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1caaf892-7144-45f0-aa20-8ddf93454ec9 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041731 Nov 19 03:26:39.086738 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 446/957] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:26:39 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:26:39.280954 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-728e152f-31e0-4513-903b-d42174f28b98 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 27775 microversion: 2.20 time: 3.136773 Nov 19 03:26:39.282325 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 512/958] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:36 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 27775 bytes in 3139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:26:40.097169 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d61e6b21-aecf-49d8-9e8f-ca32c7cde05f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:40.098764 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d61e6b21-aecf-49d8-9e8f-ca32c7cde05f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:40.105130 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d61e6b21-aecf-49d8-9e8f-ca32c7cde05f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:40.105575 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d61e6b21-aecf-49d8-9e8f-ca32c7cde05f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:40.106343 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d61e6b21-aecf-49d8-9e8f-ca32c7cde05f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:40.106797 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d61e6b21-aecf-49d8-9e8f-ca32c7cde05f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:40.135322 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d61e6b21-aecf-49d8-9e8f-ca32c7cde05f tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041928 Nov 19 03:26:40.135870 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 447/959] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:26:40 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:26:40.294702 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a684c0d8-113e-4176-976d-39b9f6bef163 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:40.295715 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a684c0d8-113e-4176-976d-39b9f6bef163 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:40.303542 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a684c0d8-113e-4176-976d-39b9f6bef163 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:40.303995 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a684c0d8-113e-4176-976d-39b9f6bef163 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:40.304777 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a684c0d8-113e-4176-976d-39b9f6bef163 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:40.305251 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a684c0d8-113e-4176-976d-39b9f6bef163 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:40.473201 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a684c0d8-113e-4176-976d-39b9f6bef163 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 27841 microversion: 2.20 time: 0.181630 Nov 19 03:26:40.474599 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 513/960] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:40 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 27841 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:41.146574 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f7da422c-43ec-4f00-aaf2-b31ab9e0c782 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:41.147477 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f7da422c-43ec-4f00-aaf2-b31ab9e0c782 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:41.153851 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f7da422c-43ec-4f00-aaf2-b31ab9e0c782 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:41.154291 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f7da422c-43ec-4f00-aaf2-b31ab9e0c782 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:41.155092 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f7da422c-43ec-4f00-aaf2-b31ab9e0c782 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:41.155515 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f7da422c-43ec-4f00-aaf2-b31ab9e0c782 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:41.183503 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f7da422c-43ec-4f00-aaf2-b31ab9e0c782 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040852 Nov 19 03:26:41.184037 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 448/961] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:26:41 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:26:41.485503 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-992863bb-9215-4621-a6d6-b790ef4bc30e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:41.486516 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-992863bb-9215-4621-a6d6-b790ef4bc30e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:41.493988 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-992863bb-9215-4621-a6d6-b790ef4bc30e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:41.494429 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-992863bb-9215-4621-a6d6-b790ef4bc30e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:41.495214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-992863bb-9215-4621-a6d6-b790ef4bc30e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:41.495642 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-992863bb-9215-4621-a6d6-b790ef4bc30e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:41.600224 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-992863bb-9215-4621-a6d6-b790ef4bc30e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28019 microversion: 2.20 time: 0.118942 Nov 19 03:26:41.600853 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 514/962] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:41 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28019 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:42.195455 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-39dcb3f7-94ad-4319-8190-bd029df8b362 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:42.196266 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-39dcb3f7-94ad-4319-8190-bd029df8b362 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:42.202385 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-39dcb3f7-94ad-4319-8190-bd029df8b362 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:42.202861 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-39dcb3f7-94ad-4319-8190-bd029df8b362 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:42.203630 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-39dcb3f7-94ad-4319-8190-bd029df8b362 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:42.204063 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-39dcb3f7-94ad-4319-8190-bd029df8b362 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:42.233844 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-39dcb3f7-94ad-4319-8190-bd029df8b362 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042931 Nov 19 03:26:42.234396 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 449/963] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:26:42 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:26:42.617572 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5ea1c6fd-5eda-4861-8dc2-7177ca8bbd73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:42.618598 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5ea1c6fd-5eda-4861-8dc2-7177ca8bbd73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:42.625343 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5ea1c6fd-5eda-4861-8dc2-7177ca8bbd73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:42.625785 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5ea1c6fd-5eda-4861-8dc2-7177ca8bbd73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:42.626578 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5ea1c6fd-5eda-4861-8dc2-7177ca8bbd73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:42.627008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5ea1c6fd-5eda-4861-8dc2-7177ca8bbd73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:42.721634 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5ea1c6fd-5eda-4861-8dc2-7177ca8bbd73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28085 microversion: 2.20 time: 0.108131 Nov 19 03:26:42.722288 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 515/964] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:42 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28085 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:26:43.245398 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f935ada3-4465-4a70-b349-16c3ac733c41 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:43.246312 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f935ada3-4465-4a70-b349-16c3ac733c41 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:43.252664 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f935ada3-4465-4a70-b349-16c3ac733c41 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:43.253113 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f935ada3-4465-4a70-b349-16c3ac733c41 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:43.253881 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f935ada3-4465-4a70-b349-16c3ac733c41 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:43.255070 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f935ada3-4465-4a70-b349-16c3ac733c41 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:43.282128 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f935ada3-4465-4a70-b349-16c3ac733c41 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040482 Nov 19 03:26:43.282709 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 450/965] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:26:43 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:26:43.293161 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-56e5862b-e0e2-4b02-a73e-176875e8ccfe tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:43.293733 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-56e5862b-e0e2-4b02-a73e-176875e8ccfe tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:43.300735 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-56e5862b-e0e2-4b02-a73e-176875e8ccfe tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:43.301697 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-56e5862b-e0e2-4b02-a73e-176875e8ccfe tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:43.302454 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-56e5862b-e0e2-4b02-a73e-176875e8ccfe tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:43.302902 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-56e5862b-e0e2-4b02-a73e-176875e8ccfe tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:43.375063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-56e5862b-e0e2-4b02-a73e-176875e8ccfe tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] HTTP exception thrown: Instance 140090bc-aacf-4ff7-8c49-35408b97f6f8 is not attached to volume 02a2ed31-73ce-42a6-b7a4-4a0bff8182f8 Nov 19 03:26:43.375651 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-56e5862b-e0e2-4b02-a73e-176875e8ccfe tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Returning 404 to user: Instance 140090bc-aacf-4ff7-8c49-35408b97f6f8 is not attached to volume 02a2ed31-73ce-42a6-b7a4-4a0bff8182f8 {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:26:43.376493 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-56e5862b-e0e2-4b02-a73e-176875e8ccfe tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "DELETE /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments/02a2ed31-73ce-42a6-b7a4-4a0bff8182f8" status: 404 len: 154 microversion: 2.1 time: 0.087705 Nov 19 03:26:43.377084 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 516/966] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Nov 19 03:26:43 2021] DELETE /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8/os-volume_attachments/02a2ed31-73ce-42a6-b7a4-4a0bff8182f8 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:26:43.733443 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-34a0d055-bb9c-42a3-a773-06c0e89aaad0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:43.734350 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-34a0d055-bb9c-42a3-a773-06c0e89aaad0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:43.741086 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34a0d055-bb9c-42a3-a773-06c0e89aaad0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:43.741529 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34a0d055-bb9c-42a3-a773-06c0e89aaad0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:43.742299 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34a0d055-bb9c-42a3-a773-06c0e89aaad0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:43.742747 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34a0d055-bb9c-42a3-a773-06c0e89aaad0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:43.842782 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-34a0d055-bb9c-42a3-a773-06c0e89aaad0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 0.112789 Nov 19 03:26:43.843410 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 451/967] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:43 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:26:44.501654 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d93ae62a-eea8-4ab0-99f0-01ab94c81349 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:44.502150 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d93ae62a-eea8-4ab0-99f0-01ab94c81349 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:44.509481 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d93ae62a-eea8-4ab0-99f0-01ab94c81349 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:44.510025 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d93ae62a-eea8-4ab0-99f0-01ab94c81349 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:44.510972 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d93ae62a-eea8-4ab0-99f0-01ab94c81349 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:44.511436 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d93ae62a-eea8-4ab0-99f0-01ab94c81349 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:44.535112 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d93ae62a-eea8-4ab0-99f0-01ab94c81349 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Going to try to terminate instance {{(pid=116065) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:26:44.606895 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d93ae62a-eea8-4ab0-99f0-01ab94c81349 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "DELETE /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 204 len: 0 microversion: 2.1 time: 0.108371 Nov 19 03:26:44.607953 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 517/968] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:26:44 2021] DELETE /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:26:44.618688 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0cbb3ee3-1940-4e7e-9d3a-c4a9d23ffb79 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:44.619445 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0cbb3ee3-1940-4e7e-9d3a-c4a9d23ffb79 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:44.626208 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0cbb3ee3-1940-4e7e-9d3a-c4a9d23ffb79 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:44.626705 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0cbb3ee3-1940-4e7e-9d3a-c4a9d23ffb79 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:44.627494 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0cbb3ee3-1940-4e7e-9d3a-c4a9d23ffb79 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:44.627947 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0cbb3ee3-1940-4e7e-9d3a-c4a9d23ffb79 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:44.757372 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0cbb3ee3-1940-4e7e-9d3a-c4a9d23ffb79 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:44.765406 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0cbb3ee3-1940-4e7e-9d3a-c4a9d23ffb79 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1555 microversion: 2.1 time: 0.152035 Nov 19 03:26:44.765978 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 452/969] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:44 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:44.855521 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5b956fbe-3dc3-4b5a-9c69-ab4a2a155dfc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:44.856517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5b956fbe-3dc3-4b5a-9c69-ab4a2a155dfc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:44.862737 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5b956fbe-3dc3-4b5a-9c69-ab4a2a155dfc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:44.863183 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5b956fbe-3dc3-4b5a-9c69-ab4a2a155dfc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:44.864232 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5b956fbe-3dc3-4b5a-9c69-ab4a2a155dfc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:44.864670 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5b956fbe-3dc3-4b5a-9c69-ab4a2a155dfc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:44.960277 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5b956fbe-3dc3-4b5a-9c69-ab4a2a155dfc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 0.108717 Nov 19 03:26:44.960900 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 518/970] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:44 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:45.783343 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8fa238e2-4196-48a0-b69f-f504313a21d2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:45.784198 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8fa238e2-4196-48a0-b69f-f504313a21d2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:45.790915 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8fa238e2-4196-48a0-b69f-f504313a21d2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:45.791353 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8fa238e2-4196-48a0-b69f-f504313a21d2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:45.792113 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8fa238e2-4196-48a0-b69f-f504313a21d2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:45.792543 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8fa238e2-4196-48a0-b69f-f504313a21d2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:45.925038 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8fa238e2-4196-48a0-b69f-f504313a21d2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:45.932970 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8fa238e2-4196-48a0-b69f-f504313a21d2 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1555 microversion: 2.1 time: 0.153541 Nov 19 03:26:45.933523 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 453/971] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:45 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:45.972062 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1e488c30-f05c-40a9-85eb-0f9843ce1d40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:45.973580 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1e488c30-f05c-40a9-85eb-0f9843ce1d40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:45.980583 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1e488c30-f05c-40a9-85eb-0f9843ce1d40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:45.981024 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1e488c30-f05c-40a9-85eb-0f9843ce1d40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:45.981784 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1e488c30-f05c-40a9-85eb-0f9843ce1d40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:45.982213 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1e488c30-f05c-40a9-85eb-0f9843ce1d40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:46.078005 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1e488c30-f05c-40a9-85eb-0f9843ce1d40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 0.109774 Nov 19 03:26:46.078700 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 519/972] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:45 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:46.949673 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a0fe0aa9-3390-458f-a44e-ad82105d614d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:46.950281 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a0fe0aa9-3390-458f-a44e-ad82105d614d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:46.957858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a0fe0aa9-3390-458f-a44e-ad82105d614d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:46.958463 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a0fe0aa9-3390-458f-a44e-ad82105d614d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:46.959515 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a0fe0aa9-3390-458f-a44e-ad82105d614d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:46.959951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a0fe0aa9-3390-458f-a44e-ad82105d614d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:47.090688 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7430bb51-28a2-4555-b665-43c5dc4144b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:47.091725 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7430bb51-28a2-4555-b665-43c5dc4144b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:47.098914 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7430bb51-28a2-4555-b665-43c5dc4144b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:47.099353 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7430bb51-28a2-4555-b665-43c5dc4144b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:47.100135 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7430bb51-28a2-4555-b665-43c5dc4144b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:47.100589 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7430bb51-28a2-4555-b665-43c5dc4144b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:47.102984 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a0fe0aa9-3390-458f-a44e-ad82105d614d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:47.111171 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a0fe0aa9-3390-458f-a44e-ad82105d614d tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1555 microversion: 2.1 time: 0.165111 Nov 19 03:26:47.111744 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 454/973] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:46 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:47.202367 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7430bb51-28a2-4555-b665-43c5dc4144b5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 0.115427 Nov 19 03:26:47.203782 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 520/974] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:47 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:26:47.665097 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-e9e965f8-d400-4793-a24b-eb6ae470f895 req-c84b3f15-4255-4088-ae18-14b6da59e076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140090bc-aacf-4ff7-8c49-35408b97f6f8", "name": "network-vif-deleted", "tag": "4ad10a71-4d53-4076-951d-e0ce7c2cbf68"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:47.666782 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:26:47.666782 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:26:47.674832 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-e9e965f8-d400-4793-a24b-eb6ae470f895 req-c84b3f15-4255-4088-ae18-14b6da59e076 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:47.675268 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-e9e965f8-d400-4793-a24b-eb6ae470f895 req-c84b3f15-4255-4088-ae18-14b6da59e076 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:47.686702 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-e9e965f8-d400-4793-a24b-eb6ae470f895 req-c84b3f15-4255-4088-ae18-14b6da59e076 service nova] Creating event network-vif-deleted:4ad10a71-4d53-4076-951d-e0ce7c2cbf68 for instance 140090bc-aacf-4ff7-8c49-35408b97f6f8 on hv-cinder-81803 Nov 19 03:26:47.691732 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-e9e965f8-d400-4793-a24b-eb6ae470f895 req-c84b3f15-4255-4088-ae18-14b6da59e076 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030855 Nov 19 03:26:47.692496 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 455/975] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:26:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:26:48.128770 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9a170456-7e8b-4960-b0b6-d63a1bd77d75 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:48.129494 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9a170456-7e8b-4960-b0b6-d63a1bd77d75 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:48.136979 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a170456-7e8b-4960-b0b6-d63a1bd77d75 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:48.137429 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a170456-7e8b-4960-b0b6-d63a1bd77d75 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:48.138208 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a170456-7e8b-4960-b0b6-d63a1bd77d75 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:48.138683 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a170456-7e8b-4960-b0b6-d63a1bd77d75 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:48.170008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a170456-7e8b-4960-b0b6-d63a1bd77d75 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:48.170381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a170456-7e8b-4960-b0b6-d63a1bd77d75 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:48.170858 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-9a170456-7e8b-4960-b0b6-d63a1bd77d75 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lazy-loading 'fault' on Instance uuid 140090bc-aacf-4ff7-8c49-35408b97f6f8 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:26:48.215350 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9a170456-7e8b-4960-b0b6-d63a1bd77d75 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:48.215954 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-20fd5bf6-3872-4da3-9c94-e04dd55e4a43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:48.217233 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-20fd5bf6-3872-4da3-9c94-e04dd55e4a43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:48.222830 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9a170456-7e8b-4960-b0b6-d63a1bd77d75 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1349 microversion: 2.1 time: 0.098037 Nov 19 03:26:48.223404 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 521/976] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:48 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:48.223873 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-20fd5bf6-3872-4da3-9c94-e04dd55e4a43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:48.224465 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-20fd5bf6-3872-4da3-9c94-e04dd55e4a43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:48.225311 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-20fd5bf6-3872-4da3-9c94-e04dd55e4a43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:48.225809 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-20fd5bf6-3872-4da3-9c94-e04dd55e4a43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:49.240762 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-bdc85988-736a-47e8-ba0b-de06d868a996 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:49.241371 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-bdc85988-736a-47e8-ba0b-de06d868a996 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:49.247720 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bdc85988-736a-47e8-ba0b-de06d868a996 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:49.248166 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bdc85988-736a-47e8-ba0b-de06d868a996 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:49.248939 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bdc85988-736a-47e8-ba0b-de06d868a996 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:49.249373 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bdc85988-736a-47e8-ba0b-de06d868a996 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:49.280423 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bdc85988-736a-47e8-ba0b-de06d868a996 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:49.280864 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bdc85988-736a-47e8-ba0b-de06d868a996 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:49.281309 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-bdc85988-736a-47e8-ba0b-de06d868a996 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lazy-loading 'fault' on Instance uuid 140090bc-aacf-4ff7-8c49-35408b97f6f8 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:26:49.324431 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-bdc85988-736a-47e8-ba0b-de06d868a996 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:49.332146 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-bdc85988-736a-47e8-ba0b-de06d868a996 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1349 microversion: 2.1 time: 0.095771 Nov 19 03:26:49.332641 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 522/977] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:49 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:26:50.348353 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5a2b6d56-dc92-422f-b856-c8f07c26a255 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:50.349526 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5a2b6d56-dc92-422f-b856-c8f07c26a255 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:50.355660 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5a2b6d56-dc92-422f-b856-c8f07c26a255 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:50.356112 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5a2b6d56-dc92-422f-b856-c8f07c26a255 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:50.356886 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5a2b6d56-dc92-422f-b856-c8f07c26a255 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:50.357324 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5a2b6d56-dc92-422f-b856-c8f07c26a255 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:50.386692 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5a2b6d56-dc92-422f-b856-c8f07c26a255 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:50.387133 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5a2b6d56-dc92-422f-b856-c8f07c26a255 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:50.387577 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-5a2b6d56-dc92-422f-b856-c8f07c26a255 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lazy-loading 'fault' on Instance uuid 140090bc-aacf-4ff7-8c49-35408b97f6f8 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:26:50.426324 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5a2b6d56-dc92-422f-b856-c8f07c26a255 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:50.434297 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5a2b6d56-dc92-422f-b856-c8f07c26a255 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1349 microversion: 2.1 time: 0.089606 Nov 19 03:26:50.434904 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 523/978] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:50 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:26:51.289602 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-20fd5bf6-3872-4da3-9c94-e04dd55e4a43 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 3.077692 Nov 19 03:26:51.290934 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 456/979] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:48 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 3080 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:26:51.451084 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-306231f5-84a6-4392-b703-c173410e0cce tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:51.451688 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-306231f5-84a6-4392-b703-c173410e0cce tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:51.457953 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-306231f5-84a6-4392-b703-c173410e0cce tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:51.458644 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-306231f5-84a6-4392-b703-c173410e0cce tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:51.459551 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-306231f5-84a6-4392-b703-c173410e0cce tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:51.459989 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-306231f5-84a6-4392-b703-c173410e0cce tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:51.489045 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-306231f5-84a6-4392-b703-c173410e0cce tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:51.490019 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-306231f5-84a6-4392-b703-c173410e0cce tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:51.490759 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-306231f5-84a6-4392-b703-c173410e0cce tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lazy-loading 'fault' on Instance uuid 140090bc-aacf-4ff7-8c49-35408b97f6f8 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:26:51.529373 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-306231f5-84a6-4392-b703-c173410e0cce tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccf75eb68e24f158f08484a003a1795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cae9fa88fe44aa9fb69e4e206b3e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:26:51.536834 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-306231f5-84a6-4392-b703-c173410e0cce tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 200 len: 1349 microversion: 2.1 time: 0.089427 Nov 19 03:26:51.537397 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 524/980] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:51 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:26:52.301707 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4921785f-7dc7-4be1-8f43-f1b3a84ff3c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:52.302746 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4921785f-7dc7-4be1-8f43-f1b3a84ff3c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:52.309705 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4921785f-7dc7-4be1-8f43-f1b3a84ff3c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:52.310149 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4921785f-7dc7-4be1-8f43-f1b3a84ff3c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:52.310944 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4921785f-7dc7-4be1-8f43-f1b3a84ff3c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:52.311371 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4921785f-7dc7-4be1-8f43-f1b3a84ff3c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:52.415384 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4921785f-7dc7-4be1-8f43-f1b3a84ff3c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 0.117614 Nov 19 03:26:52.423307 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 457/981] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:52 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:52.553206 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6a232269-8100-477b-8092-35151d8aca58 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:52.553783 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6a232269-8100-477b-8092-35151d8aca58 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] [instance: 140090bc-aacf-4ff7-8c49-35408b97f6f8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:52.560045 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6a232269-8100-477b-8092-35151d8aca58 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:52.560496 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6a232269-8100-477b-8092-35151d8aca58 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:52.561269 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6a232269-8100-477b-8092-35151d8aca58 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:52.561706 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6a232269-8100-477b-8092-35151d8aca58 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:52.575243 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-6a232269-8100-477b-8092-35151d8aca58 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] HTTP exception thrown: Instance 140090bc-aacf-4ff7-8c49-35408b97f6f8 could not be found. Nov 19 03:26:52.575814 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6a232269-8100-477b-8092-35151d8aca58 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Returning 404 to user: Instance 140090bc-aacf-4ff7-8c49-35408b97f6f8 could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:26:52.576620 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6a232269-8100-477b-8092-35151d8aca58 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8" status: 404 len: 111 microversion: 2.1 time: 0.027209 Nov 19 03:26:52.577530 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 525/982] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:26:52 2021] GET /compute/v2.1/servers/140090bc-aacf-4ff7-8c49-35408b97f6f8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:26:52.586534 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-157b39a0-d83d-45b7-bd89-38bbf9be3d63 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] Calling method '.version_select at 0x7f845a082b80>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:26:52.603830 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-157b39a0-d83d-45b7-bd89-38bbf9be3d63 tempest-TestMinimumBasicScenario-550867465 tempest-TestMinimumBasicScenario-550867465-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1490067239" status: 202 len: 0 microversion: 2.1 time: 0.021867 Nov 19 03:26:52.604375 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 458/983] 10.222.0.47 () {58 vars in 1271 bytes} [Fri Nov 19 03:26:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1490067239 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:53.428389 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e4b02bfc-91ee-4696-9388-7db5d2b77f54 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:53.429330 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e4b02bfc-91ee-4696-9388-7db5d2b77f54 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:53.436889 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e4b02bfc-91ee-4696-9388-7db5d2b77f54 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:53.437626 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e4b02bfc-91ee-4696-9388-7db5d2b77f54 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:53.438431 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e4b02bfc-91ee-4696-9388-7db5d2b77f54 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:53.439007 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e4b02bfc-91ee-4696-9388-7db5d2b77f54 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:53.536943 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e4b02bfc-91ee-4696-9388-7db5d2b77f54 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 0.112601 Nov 19 03:26:53.538067 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 526/984] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:53 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:54.550273 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6210c2d4-acfd-4fac-924c-0dd662006fa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:54.552795 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6210c2d4-acfd-4fac-924c-0dd662006fa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:54.559427 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6210c2d4-acfd-4fac-924c-0dd662006fa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:54.559898 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6210c2d4-acfd-4fac-924c-0dd662006fa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:54.560684 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6210c2d4-acfd-4fac-924c-0dd662006fa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:54.561117 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6210c2d4-acfd-4fac-924c-0dd662006fa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:54.647483 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6210c2d4-acfd-4fac-924c-0dd662006fa8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 0.101746 Nov 19 03:26:54.648129 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 459/985] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:54 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:55.658865 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-afaaa60a-d427-412c-a5f2-8e5e70fb82d6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:55.660250 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-afaaa60a-d427-412c-a5f2-8e5e70fb82d6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:55.667641 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-afaaa60a-d427-412c-a5f2-8e5e70fb82d6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:55.668094 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-afaaa60a-d427-412c-a5f2-8e5e70fb82d6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:55.668872 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-afaaa60a-d427-412c-a5f2-8e5e70fb82d6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:55.669311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-afaaa60a-d427-412c-a5f2-8e5e70fb82d6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:55.798872 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-afaaa60a-d427-412c-a5f2-8e5e70fb82d6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 0.143896 Nov 19 03:26:55.800696 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 527/986] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:55 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:56.812699 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2782648a-6a42-4cae-8320-0283784bc1a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:56.813736 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2782648a-6a42-4cae-8320-0283784bc1a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:56.820760 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2782648a-6a42-4cae-8320-0283784bc1a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:56.821214 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2782648a-6a42-4cae-8320-0283784bc1a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:56.827666 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2782648a-6a42-4cae-8320-0283784bc1a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:56.828064 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2782648a-6a42-4cae-8320-0283784bc1a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:56.921321 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2782648a-6a42-4cae-8320-0283784bc1a3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 0.112530 Nov 19 03:26:56.921915 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 460/987] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:56 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:26:57.935325 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c0740db1-e089-404e-8bbb-0426ca8acb49 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:57.936524 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c0740db1-e089-404e-8bbb-0426ca8acb49 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:57.949177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c0740db1-e089-404e-8bbb-0426ca8acb49 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:57.952913 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c0740db1-e089-404e-8bbb-0426ca8acb49 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:57.957075 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c0740db1-e089-404e-8bbb-0426ca8acb49 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:57.957521 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c0740db1-e089-404e-8bbb-0426ca8acb49 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:58.067713 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c0740db1-e089-404e-8bbb-0426ca8acb49 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 0.136337 Nov 19 03:26:58.071980 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 528/988] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:57 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:26:59.083806 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-963c5eea-d558-4d9d-954a-c9bf53331824 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:26:59.087525 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-963c5eea-d558-4d9d-954a-c9bf53331824 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:26:59.100954 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-963c5eea-d558-4d9d-954a-c9bf53331824 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:59.101686 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-963c5eea-d558-4d9d-954a-c9bf53331824 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:59.102678 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-963c5eea-d558-4d9d-954a-c9bf53331824 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:26:59.103353 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-963c5eea-d558-4d9d-954a-c9bf53331824 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:26:59.195703 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-963c5eea-d558-4d9d-954a-c9bf53331824 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 0.119409 Nov 19 03:26:59.199727 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 461/989] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:26:59 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:00.207103 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8db7b271-b8c0-4fcc-9ce6-18e5fa7b96ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:00.208842 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8db7b271-b8c0-4fcc-9ce6-18e5fa7b96ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:00.216558 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8db7b271-b8c0-4fcc-9ce6-18e5fa7b96ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:00.217041 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8db7b271-b8c0-4fcc-9ce6-18e5fa7b96ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:00.217859 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8db7b271-b8c0-4fcc-9ce6-18e5fa7b96ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:00.218298 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8db7b271-b8c0-4fcc-9ce6-18e5fa7b96ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:00.302974 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8db7b271-b8c0-4fcc-9ce6-18e5fa7b96ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 0.099545 Nov 19 03:27:00.303617 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 529/990] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:00 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:27:01.315202 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ad6b2aeb-7ce9-46aa-9fc7-c092ca2a47a7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:01.316131 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ad6b2aeb-7ce9-46aa-9fc7-c092ca2a47a7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:01.323645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ad6b2aeb-7ce9-46aa-9fc7-c092ca2a47a7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:01.324095 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ad6b2aeb-7ce9-46aa-9fc7-c092ca2a47a7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:01.324868 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ad6b2aeb-7ce9-46aa-9fc7-c092ca2a47a7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:01.325299 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ad6b2aeb-7ce9-46aa-9fc7-c092ca2a47a7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:01.411707 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ad6b2aeb-7ce9-46aa-9fc7-c092ca2a47a7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28202 microversion: 2.20 time: 0.100459 Nov 19 03:27:01.412336 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 462/991] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:01 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28202 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:02.423717 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3ba56807-b0b3-48a2-95c5-b28f074fa191 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:02.424664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3ba56807-b0b3-48a2-95c5-b28f074fa191 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:02.431486 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3ba56807-b0b3-48a2-95c5-b28f074fa191 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:02.431927 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3ba56807-b0b3-48a2-95c5-b28f074fa191 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:02.432691 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3ba56807-b0b3-48a2-95c5-b28f074fa191 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:02.433118 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3ba56807-b0b3-48a2-95c5-b28f074fa191 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:02.526675 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3ba56807-b0b3-48a2-95c5-b28f074fa191 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28493 microversion: 2.20 time: 0.106837 Nov 19 03:27:02.527567 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 530/992] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:02 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28493 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:03.539297 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-86049d1b-8f7c-443f-9a3a-5e1a0af32e27 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:03.540299 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-86049d1b-8f7c-443f-9a3a-5e1a0af32e27 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:03.547278 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-86049d1b-8f7c-443f-9a3a-5e1a0af32e27 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:03.547733 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-86049d1b-8f7c-443f-9a3a-5e1a0af32e27 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:03.548507 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-86049d1b-8f7c-443f-9a3a-5e1a0af32e27 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:03.548941 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-86049d1b-8f7c-443f-9a3a-5e1a0af32e27 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:03.640589 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-86049d1b-8f7c-443f-9a3a-5e1a0af32e27 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.105248 Nov 19 03:27:03.641235 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 463/993] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:03 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:04.653422 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-11f37ec6-54c9-4fc5-9f76-1bb809ef8c4e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:04.654419 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-11f37ec6-54c9-4fc5-9f76-1bb809ef8c4e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:04.661298 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-11f37ec6-54c9-4fc5-9f76-1bb809ef8c4e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:04.661799 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-11f37ec6-54c9-4fc5-9f76-1bb809ef8c4e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:04.662652 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-11f37ec6-54c9-4fc5-9f76-1bb809ef8c4e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:04.663093 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-11f37ec6-54c9-4fc5-9f76-1bb809ef8c4e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:04.744855 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-11f37ec6-54c9-4fc5-9f76-1bb809ef8c4e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.095339 Nov 19 03:27:04.745603 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 531/994] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:04 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:05.757629 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4e60eb27-2caa-46e9-bd78-4518e906c2c7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:05.758668 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4e60eb27-2caa-46e9-bd78-4518e906c2c7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:05.765265 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e60eb27-2caa-46e9-bd78-4518e906c2c7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:05.765721 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e60eb27-2caa-46e9-bd78-4518e906c2c7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:05.766528 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e60eb27-2caa-46e9-bd78-4518e906c2c7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:05.766966 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e60eb27-2caa-46e9-bd78-4518e906c2c7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:05.865300 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4e60eb27-2caa-46e9-bd78-4518e906c2c7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.111833 Nov 19 03:27:05.866099 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 464/995] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:05 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:27:06.877363 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-54a437e2-7491-4570-8ac2-770b6c8c7bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:06.878357 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-54a437e2-7491-4570-8ac2-770b6c8c7bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:06.885773 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-54a437e2-7491-4570-8ac2-770b6c8c7bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:06.886222 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-54a437e2-7491-4570-8ac2-770b6c8c7bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:06.887033 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-54a437e2-7491-4570-8ac2-770b6c8c7bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:06.887470 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-54a437e2-7491-4570-8ac2-770b6c8c7bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:10.164150 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-54a437e2-7491-4570-8ac2-770b6c8c7bc6 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 3.290755 Nov 19 03:27:10.164809 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 532/996] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:06 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 3292 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:11.176089 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8f0ba45f-dadb-4987-9634-4b8a70471978 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:11.177697 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8f0ba45f-dadb-4987-9634-4b8a70471978 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:11.184203 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8f0ba45f-dadb-4987-9634-4b8a70471978 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:11.184654 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8f0ba45f-dadb-4987-9634-4b8a70471978 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:11.185429 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8f0ba45f-dadb-4987-9634-4b8a70471978 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:11.185863 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8f0ba45f-dadb-4987-9634-4b8a70471978 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:11.275378 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8f0ba45f-dadb-4987-9634-4b8a70471978 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.103186 Nov 19 03:27:11.279250 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 465/997] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:11 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:12.287981 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-30ff73ed-8e6c-4762-aaf3-56c693331c11 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:12.288990 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-30ff73ed-8e6c-4762-aaf3-56c693331c11 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:12.296702 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-30ff73ed-8e6c-4762-aaf3-56c693331c11 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:12.297676 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-30ff73ed-8e6c-4762-aaf3-56c693331c11 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:12.297943 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-30ff73ed-8e6c-4762-aaf3-56c693331c11 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:12.298378 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-30ff73ed-8e6c-4762-aaf3-56c693331c11 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:12.385846 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-30ff73ed-8e6c-4762-aaf3-56c693331c11 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.102253 Nov 19 03:27:12.386534 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 533/998] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:12 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:13.398460 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6a7cb7cc-99d0-43df-8a83-cc9720020ed2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:13.399517 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6a7cb7cc-99d0-43df-8a83-cc9720020ed2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:13.406319 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6a7cb7cc-99d0-43df-8a83-cc9720020ed2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:13.406801 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6a7cb7cc-99d0-43df-8a83-cc9720020ed2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:13.407574 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6a7cb7cc-99d0-43df-8a83-cc9720020ed2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:13.408041 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6a7cb7cc-99d0-43df-8a83-cc9720020ed2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:13.492060 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6a7cb7cc-99d0-43df-8a83-cc9720020ed2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.098275 Nov 19 03:27:13.492719 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 466/999] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:13 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:14.504205 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-95b7b37b-dbd0-4afc-80ca-60fbc1492d70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:14.505448 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-95b7b37b-dbd0-4afc-80ca-60fbc1492d70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:14.512396 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-95b7b37b-dbd0-4afc-80ca-60fbc1492d70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:14.512845 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-95b7b37b-dbd0-4afc-80ca-60fbc1492d70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:14.513625 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-95b7b37b-dbd0-4afc-80ca-60fbc1492d70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:14.514058 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-95b7b37b-dbd0-4afc-80ca-60fbc1492d70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:14.600543 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-95b7b37b-dbd0-4afc-80ca-60fbc1492d70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.100301 Nov 19 03:27:14.601402 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 534/1000] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:14 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:15.613056 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c77e4614-32d2-40d1-8b2e-9aa102f25a48 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:15.613954 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c77e4614-32d2-40d1-8b2e-9aa102f25a48 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:15.620989 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c77e4614-32d2-40d1-8b2e-9aa102f25a48 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:15.621431 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c77e4614-32d2-40d1-8b2e-9aa102f25a48 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:15.622195 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c77e4614-32d2-40d1-8b2e-9aa102f25a48 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:15.622652 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c77e4614-32d2-40d1-8b2e-9aa102f25a48 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:15.716395 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c77e4614-32d2-40d1-8b2e-9aa102f25a48 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.107273 Nov 19 03:27:15.717268 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 467/1001] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:15 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:16.728987 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e41418b9-86de-48bc-b867-9c1559c10808 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:16.730008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e41418b9-86de-48bc-b867-9c1559c10808 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:16.736819 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e41418b9-86de-48bc-b867-9c1559c10808 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:16.737267 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e41418b9-86de-48bc-b867-9c1559c10808 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:16.738040 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e41418b9-86de-48bc-b867-9c1559c10808 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:16.738492 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e41418b9-86de-48bc-b867-9c1559c10808 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:16.836167 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e41418b9-86de-48bc-b867-9c1559c10808 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.111050 Nov 19 03:27:16.836810 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 535/1002] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:16 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:17.848446 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-af13f1bd-957d-47da-8c18-740ed6f007a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:17.849439 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-af13f1bd-957d-47da-8c18-740ed6f007a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:17.856378 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af13f1bd-957d-47da-8c18-740ed6f007a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:17.856825 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af13f1bd-957d-47da-8c18-740ed6f007a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:17.857596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af13f1bd-957d-47da-8c18-740ed6f007a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:17.858024 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-af13f1bd-957d-47da-8c18-740ed6f007a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:17.948499 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-af13f1bd-957d-47da-8c18-740ed6f007a8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.103925 Nov 19 03:27:17.949467 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 468/1003] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:17 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:18.961604 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e19b461a-52f5-4a5b-8776-d91d9cb2f662 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:18.962663 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e19b461a-52f5-4a5b-8776-d91d9cb2f662 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:18.969759 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e19b461a-52f5-4a5b-8776-d91d9cb2f662 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:18.970211 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e19b461a-52f5-4a5b-8776-d91d9cb2f662 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:18.971027 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e19b461a-52f5-4a5b-8776-d91d9cb2f662 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:18.971463 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e19b461a-52f5-4a5b-8776-d91d9cb2f662 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:19.059091 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e19b461a-52f5-4a5b-8776-d91d9cb2f662 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.102174 Nov 19 03:27:19.060178 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 536/1004] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:18 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:20.071483 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2fbb9bab-8f7c-4333-950e-b230ba794cac tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:20.072994 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2fbb9bab-8f7c-4333-950e-b230ba794cac tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:20.081808 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2fbb9bab-8f7c-4333-950e-b230ba794cac tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:20.082326 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2fbb9bab-8f7c-4333-950e-b230ba794cac tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:20.083161 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2fbb9bab-8f7c-4333-950e-b230ba794cac tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:20.083621 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2fbb9bab-8f7c-4333-950e-b230ba794cac tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:20.178172 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2fbb9bab-8f7c-4333-950e-b230ba794cac tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.111053 Nov 19 03:27:20.179678 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 469/1005] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:20 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:21.190579 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6c7b56ef-3def-4ec3-aeb0-19aa156eee24 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:21.191587 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-6c7b56ef-3def-4ec3-aeb0-19aa156eee24 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:21.198603 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6c7b56ef-3def-4ec3-aeb0-19aa156eee24 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:21.199055 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6c7b56ef-3def-4ec3-aeb0-19aa156eee24 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:21.199837 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6c7b56ef-3def-4ec3-aeb0-19aa156eee24 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:21.200273 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-6c7b56ef-3def-4ec3-aeb0-19aa156eee24 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:21.313738 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6c7b56ef-3def-4ec3-aeb0-19aa156eee24 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.127007 Nov 19 03:27:21.314519 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 537/1006] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:21 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:22.326316 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1c2b31ab-5929-4436-8fbe-22dd24512475 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:22.327554 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1c2b31ab-5929-4436-8fbe-22dd24512475 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:22.334446 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1c2b31ab-5929-4436-8fbe-22dd24512475 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:22.335139 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1c2b31ab-5929-4436-8fbe-22dd24512475 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:22.335911 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1c2b31ab-5929-4436-8fbe-22dd24512475 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:22.336349 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1c2b31ab-5929-4436-8fbe-22dd24512475 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:22.434833 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1c2b31ab-5929-4436-8fbe-22dd24512475 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.112307 Nov 19 03:27:22.435583 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 470/1007] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:22 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:23.447219 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2aa348dc-ba1d-406a-820b-e851ac4d4488 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:23.448220 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2aa348dc-ba1d-406a-820b-e851ac4d4488 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:23.455479 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2aa348dc-ba1d-406a-820b-e851ac4d4488 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:23.455929 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2aa348dc-ba1d-406a-820b-e851ac4d4488 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:23.456919 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2aa348dc-ba1d-406a-820b-e851ac4d4488 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:23.457410 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2aa348dc-ba1d-406a-820b-e851ac4d4488 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:23.552390 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2aa348dc-ba1d-406a-820b-e851ac4d4488 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.108672 Nov 19 03:27:23.553597 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 538/1008] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:23 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:24.564946 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1425649d-0176-458e-aaa6-7434c8c8bc57 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:24.565950 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1425649d-0176-458e-aaa6-7434c8c8bc57 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:24.573115 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1425649d-0176-458e-aaa6-7434c8c8bc57 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:24.573556 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1425649d-0176-458e-aaa6-7434c8c8bc57 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:24.574334 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1425649d-0176-458e-aaa6-7434c8c8bc57 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:24.574804 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1425649d-0176-458e-aaa6-7434c8c8bc57 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:24.663856 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1425649d-0176-458e-aaa6-7434c8c8bc57 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.102788 Nov 19 03:27:24.664509 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 471/1009] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:24 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:25.676767 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c8a9bc27-5639-4c1a-91ed-c600dda655ed tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:25.677790 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c8a9bc27-5639-4c1a-91ed-c600dda655ed tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:25.684767 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c8a9bc27-5639-4c1a-91ed-c600dda655ed tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:25.685242 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c8a9bc27-5639-4c1a-91ed-c600dda655ed tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:25.686015 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c8a9bc27-5639-4c1a-91ed-c600dda655ed tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:25.686449 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c8a9bc27-5639-4c1a-91ed-c600dda655ed tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:25.779075 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c8a9bc27-5639-4c1a-91ed-c600dda655ed tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.107135 Nov 19 03:27:25.780020 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 539/1010] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:25 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:26.792087 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ad1fd68f-8b3e-4e20-9b67-c4bd8aa8a481 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:26.793238 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ad1fd68f-8b3e-4e20-9b67-c4bd8aa8a481 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:26.800107 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ad1fd68f-8b3e-4e20-9b67-c4bd8aa8a481 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:26.800553 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ad1fd68f-8b3e-4e20-9b67-c4bd8aa8a481 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:26.801327 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ad1fd68f-8b3e-4e20-9b67-c4bd8aa8a481 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:26.801759 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ad1fd68f-8b3e-4e20-9b67-c4bd8aa8a481 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:26.895177 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ad1fd68f-8b3e-4e20-9b67-c4bd8aa8a481 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.107486 Nov 19 03:27:26.895751 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 472/1011] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:26 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:27.907781 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0d060ea2-fa49-4059-9540-fb7594a87ffd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:27.908721 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0d060ea2-fa49-4059-9540-fb7594a87ffd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:27.916374 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d060ea2-fa49-4059-9540-fb7594a87ffd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:27.917116 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d060ea2-fa49-4059-9540-fb7594a87ffd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:27.917584 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d060ea2-fa49-4059-9540-fb7594a87ffd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:27.918021 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d060ea2-fa49-4059-9540-fb7594a87ffd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:28.172685 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0d060ea2-fa49-4059-9540-fb7594a87ffd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.268722 Nov 19 03:27:28.173255 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 540/1012] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:27 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:29.185247 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6e936f98-7ec1-4a65-bab9-71166f8a16fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:29.186171 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6e936f98-7ec1-4a65-bab9-71166f8a16fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:29.193088 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e936f98-7ec1-4a65-bab9-71166f8a16fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:29.193633 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e936f98-7ec1-4a65-bab9-71166f8a16fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:29.195014 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e936f98-7ec1-4a65-bab9-71166f8a16fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:29.195469 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6e936f98-7ec1-4a65-bab9-71166f8a16fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:29.287888 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6e936f98-7ec1-4a65-bab9-71166f8a16fc tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.106038 Nov 19 03:27:29.288906 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 473/1013] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:29 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:30.299518 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-68f03eed-d1f0-42cf-963b-36e1676d29ee tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:30.300503 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-68f03eed-d1f0-42cf-963b-36e1676d29ee tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:30.307920 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-68f03eed-d1f0-42cf-963b-36e1676d29ee tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:30.308367 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-68f03eed-d1f0-42cf-963b-36e1676d29ee tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:30.309136 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-68f03eed-d1f0-42cf-963b-36e1676d29ee tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:30.309566 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-68f03eed-d1f0-42cf-963b-36e1676d29ee tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:30.418415 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-68f03eed-d1f0-42cf-963b-36e1676d29ee tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.122637 Nov 19 03:27:30.418991 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 541/1014] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:30 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:31.430091 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8540d4d0-5553-4740-acec-a24b75267f02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:31.431035 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8540d4d0-5553-4740-acec-a24b75267f02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:31.440012 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8540d4d0-5553-4740-acec-a24b75267f02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:31.440808 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8540d4d0-5553-4740-acec-a24b75267f02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:31.442206 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8540d4d0-5553-4740-acec-a24b75267f02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:31.443022 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8540d4d0-5553-4740-acec-a24b75267f02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:31.544836 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8540d4d0-5553-4740-acec-a24b75267f02 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.119097 Nov 19 03:27:31.545482 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 474/1015] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:31 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:32.557521 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d7e2bafa-d86a-4a6b-8fb5-2890e0095988 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:32.558546 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d7e2bafa-d86a-4a6b-8fb5-2890e0095988 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:32.565392 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d7e2bafa-d86a-4a6b-8fb5-2890e0095988 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:32.565837 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d7e2bafa-d86a-4a6b-8fb5-2890e0095988 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:32.566637 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d7e2bafa-d86a-4a6b-8fb5-2890e0095988 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:32.567071 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d7e2bafa-d86a-4a6b-8fb5-2890e0095988 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:32.686640 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d7e2bafa-d86a-4a6b-8fb5-2890e0095988 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.133650 Nov 19 03:27:32.687247 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 542/1016] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:32 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:33.698903 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-37a432e9-a193-4c5c-877c-c900e13dc326 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:33.699895 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-37a432e9-a193-4c5c-877c-c900e13dc326 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:33.706696 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-37a432e9-a193-4c5c-877c-c900e13dc326 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:33.707137 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-37a432e9-a193-4c5c-877c-c900e13dc326 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:33.707902 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-37a432e9-a193-4c5c-877c-c900e13dc326 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:33.708327 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-37a432e9-a193-4c5c-877c-c900e13dc326 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:33.809783 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-37a432e9-a193-4c5c-877c-c900e13dc326 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.114751 Nov 19 03:27:33.810431 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 475/1017] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:33 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:34.822510 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-386cdf66-f23d-4307-9929-ca4888ef45bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:34.823549 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-386cdf66-f23d-4307-9929-ca4888ef45bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:34.830333 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-386cdf66-f23d-4307-9929-ca4888ef45bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:34.830828 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-386cdf66-f23d-4307-9929-ca4888ef45bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:34.831613 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-386cdf66-f23d-4307-9929-ca4888ef45bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:34.832111 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-386cdf66-f23d-4307-9929-ca4888ef45bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:34.870770 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-bc3878d5-8556-44b7-af31-e1a9bbb029e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:34.871764 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-bc3878d5-8556-44b7-af31-e1a9bbb029e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:34.878615 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bc3878d5-8556-44b7-af31-e1a9bbb029e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:34.879063 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bc3878d5-8556-44b7-af31-e1a9bbb029e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:34.879883 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bc3878d5-8556-44b7-af31-e1a9bbb029e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:34.880262 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bc3878d5-8556-44b7-af31-e1a9bbb029e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:34.909161 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-bc3878d5-8556-44b7-af31-e1a9bbb029e9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043427 Nov 19 03:27:34.909707 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 476/1018] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:27:34 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:27:34.942703 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-386cdf66-f23d-4307-9929-ca4888ef45bd tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.124971 Nov 19 03:27:34.943428 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 543/1019] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:34 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:34.965070 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e08a530c-c604-483e-9616-be1c83a7fee0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:34.965465 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e08a530c-c604-483e-9616-be1c83a7fee0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:34.971751 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e08a530c-c604-483e-9616-be1c83a7fee0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:34.972196 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e08a530c-c604-483e-9616-be1c83a7fee0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:34.972971 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e08a530c-c604-483e-9616-be1c83a7fee0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:34.973404 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e08a530c-c604-483e-9616-be1c83a7fee0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:34.999715 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e08a530c-c604-483e-9616-be1c83a7fee0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Going to try to terminate instance {{(pid=116066) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:27:35.075364 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e08a530c-c604-483e-9616-be1c83a7fee0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 204 len: 0 microversion: 2.1 time: 0.113734 Nov 19 03:27:35.076061 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 477/1020] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:27:34 2021] DELETE /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:27:35.085066 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0d210294-85db-4ed3-8655-d92d2d43295e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:35.085766 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0d210294-85db-4ed3-8655-d92d2d43295e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:35.092566 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d210294-85db-4ed3-8655-d92d2d43295e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:35.093014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d210294-85db-4ed3-8655-d92d2d43295e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:35.093786 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d210294-85db-4ed3-8655-d92d2d43295e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:35.094396 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0d210294-85db-4ed3-8655-d92d2d43295e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:35.225435 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0d210294-85db-4ed3-8655-d92d2d43295e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:35.233315 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0d210294-85db-4ed3-8655-d92d2d43295e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1673 microversion: 2.1 time: 0.152342 Nov 19 03:27:35.233888 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 544/1021] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:35 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:27:35.955586 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-db8dad2d-f547-4013-a2ef-00f5a6937356 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:35.956584 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-db8dad2d-f547-4013-a2ef-00f5a6937356 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:35.963583 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-db8dad2d-f547-4013-a2ef-00f5a6937356 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:35.964028 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-db8dad2d-f547-4013-a2ef-00f5a6937356 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:35.964790 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-db8dad2d-f547-4013-a2ef-00f5a6937356 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:35.965215 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-db8dad2d-f547-4013-a2ef-00f5a6937356 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:36.058166 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-db8dad2d-f547-4013-a2ef-00f5a6937356 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.106489 Nov 19 03:27:36.059052 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 478/1022] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:35 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:36.251882 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5bd3e915-c6c0-42a2-bc6c-6ebc99dc00fc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:36.252564 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5bd3e915-c6c0-42a2-bc6c-6ebc99dc00fc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:36.261386 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5bd3e915-c6c0-42a2-bc6c-6ebc99dc00fc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:36.261830 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5bd3e915-c6c0-42a2-bc6c-6ebc99dc00fc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:36.262636 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5bd3e915-c6c0-42a2-bc6c-6ebc99dc00fc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:36.263070 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5bd3e915-c6c0-42a2-bc6c-6ebc99dc00fc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:36.397252 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-5bd3e915-c6c0-42a2-bc6c-6ebc99dc00fc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:36.404577 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5bd3e915-c6c0-42a2-bc6c-6ebc99dc00fc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1673 microversion: 2.1 time: 0.156666 Nov 19 03:27:36.405157 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 545/1023] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:36 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:27:37.070246 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4a5bd08e-c907-438c-a788-b2a444c98365 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:37.071907 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4a5bd08e-c907-438c-a788-b2a444c98365 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:37.079745 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4a5bd08e-c907-438c-a788-b2a444c98365 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:37.080203 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4a5bd08e-c907-438c-a788-b2a444c98365 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:37.080995 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4a5bd08e-c907-438c-a788-b2a444c98365 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:37.081432 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4a5bd08e-c907-438c-a788-b2a444c98365 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:37.175454 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4a5bd08e-c907-438c-a788-b2a444c98365 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.109656 Nov 19 03:27:37.178750 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 479/1024] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:37 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:37.422206 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-66e8f34f-0818-4bb3-af3e-fcf06958858c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:37.422850 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-66e8f34f-0818-4bb3-af3e-fcf06958858c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:37.429822 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-66e8f34f-0818-4bb3-af3e-fcf06958858c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:37.430285 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-66e8f34f-0818-4bb3-af3e-fcf06958858c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:37.431117 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-66e8f34f-0818-4bb3-af3e-fcf06958858c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:37.431594 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-66e8f34f-0818-4bb3-af3e-fcf06958858c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:37.498887 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-66e8f34f-0818-4bb3-af3e-fcf06958858c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:37.509831 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-66e8f34f-0818-4bb3-af3e-fcf06958858c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 200 len: 1605 microversion: 2.1 time: 0.091229 Nov 19 03:27:37.510411 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 546/1025] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:37 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 1605 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:27:37.767233 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-86c3c13a-c365-4efb-aa71-23cec9e599cb req-37d39942-46ad-46e0-be5d-7c13d0f125a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5741fba7-f551-445e-833f-303eca2c8dae", "name": "network-vif-deleted", "tag": "3e4fe64e-0ede-4166-9e29-1ae375f51703"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:37.769023 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:27:37.769023 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:27:37.779610 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-86c3c13a-c365-4efb-aa71-23cec9e599cb req-37d39942-46ad-46e0-be5d-7c13d0f125a2 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:37.780237 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-86c3c13a-c365-4efb-aa71-23cec9e599cb req-37d39942-46ad-46e0-be5d-7c13d0f125a2 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:37.792761 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-86c3c13a-c365-4efb-aa71-23cec9e599cb req-37d39942-46ad-46e0-be5d-7c13d0f125a2 service nova] Creating event network-vif-deleted:3e4fe64e-0ede-4166-9e29-1ae375f51703 for instance 5741fba7-f551-445e-833f-303eca2c8dae on hv-cinder-81803 Nov 19 03:27:37.798176 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-86c3c13a-c365-4efb-aa71-23cec9e599cb req-37d39942-46ad-46e0-be5d-7c13d0f125a2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034591 Nov 19 03:27:37.799167 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 480/1026] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:27:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:27:38.187384 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-07f13539-a985-4bd8-826d-a095f3c44e4b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:38.188448 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-07f13539-a985-4bd8-826d-a095f3c44e4b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:38.195621 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-07f13539-a985-4bd8-826d-a095f3c44e4b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:38.196154 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-07f13539-a985-4bd8-826d-a095f3c44e4b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:38.196992 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-07f13539-a985-4bd8-826d-a095f3c44e4b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:38.197496 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-07f13539-a985-4bd8-826d-a095f3c44e4b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:38.311426 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-07f13539-a985-4bd8-826d-a095f3c44e4b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.127533 Nov 19 03:27:38.312063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 547/1027] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:38 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:38.528531 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4e8bad9e-4bcf-4c69-a918-145b9110cee6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:38.529147 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4e8bad9e-4bcf-4c69-a918-145b9110cee6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:38.536179 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e8bad9e-4bcf-4c69-a918-145b9110cee6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:38.536629 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e8bad9e-4bcf-4c69-a918-145b9110cee6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:38.537649 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e8bad9e-4bcf-4c69-a918-145b9110cee6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:38.538239 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4e8bad9e-4bcf-4c69-a918-145b9110cee6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:38.551963 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-4e8bad9e-4bcf-4c69-a918-145b9110cee6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] HTTP exception thrown: Instance 5741fba7-f551-445e-833f-303eca2c8dae could not be found. Nov 19 03:27:38.552556 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4e8bad9e-4bcf-4c69-a918-145b9110cee6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Returning 404 to user: Instance 5741fba7-f551-445e-833f-303eca2c8dae could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:27:38.554026 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4e8bad9e-4bcf-4c69-a918-145b9110cee6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 404 len: 111 microversion: 2.1 time: 0.029500 Nov 19 03:27:38.554599 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 481/1028] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:38 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:27:38.563227 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9ca7f937-c9f9-42be-91d8-1bf105ce1eb3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '.version_select at 0x7f8459f9c9d0>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:38.581586 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9ca7f937-c9f9-42be-91d8-1bf105ce1eb3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-777798237" status: 202 len: 0 microversion: 2.1 time: 0.022229 Nov 19 03:27:38.582174 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 548/1029] 10.222.0.47 () {58 vars in 1217 bytes} [Fri Nov 19 03:27:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-777798237 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:39.266338 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cecd2c47-2c7f-403e-b147-9ea9c4a65444 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'create', calling method: .version_select at 0x7f845a14dc10>, body: {"keypair": {"name": "tempest-keypair-1949391301"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:39.286587 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-cecd2c47-2c7f-403e-b147-9ea9c4a65444 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Getting quotas for project 47d64b0b6d824dcaa62fc05f714c4d3b. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:27:39.291157 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-cecd2c47-2c7f-403e-b147-9ea9c4a65444 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Getting quotas for user 10f233fb185241e8a04f8ce5d27c0bd9 and project 47d64b0b6d824dcaa62fc05f714c4d3b. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:27:39.323459 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f517b92d-50b1-4928-89fc-cc83884106e8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:39.324510 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f517b92d-50b1-4928-89fc-cc83884106e8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:39.331370 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f517b92d-50b1-4928-89fc-cc83884106e8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:39.331765 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f517b92d-50b1-4928-89fc-cc83884106e8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:39.332522 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f517b92d-50b1-4928-89fc-cc83884106e8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:39.332937 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f517b92d-50b1-4928-89fc-cc83884106e8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:39.425184 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f517b92d-50b1-4928-89fc-cc83884106e8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.105969 Nov 19 03:27:39.425851 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 549/1030] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:39 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:27:39.550351 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-cecd2c47-2c7f-403e-b147-9ea9c4a65444 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Getting quotas for project 47d64b0b6d824dcaa62fc05f714c4d3b. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:27:39.553978 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-cecd2c47-2c7f-403e-b147-9ea9c4a65444 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Getting quotas for user 10f233fb185241e8a04f8ce5d27c0bd9 and project 47d64b0b6d824dcaa62fc05f714c4d3b. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:27:39.567205 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cecd2c47-2c7f-403e-b147-9ea9c4a65444 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.304346 Nov 19 03:27:39.568325 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 482/1031] 10.222.0.47 () {60 vars in 1157 bytes} [Fri Nov 19 03:27:39 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:27:40.438359 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e2875302-a3a4-41ec-924b-5c7158f85527 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:40.439470 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e2875302-a3a4-41ec-924b-5c7158f85527 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:40.447326 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e2875302-a3a4-41ec-924b-5c7158f85527 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:40.447774 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e2875302-a3a4-41ec-924b-5c7158f85527 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:40.448560 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e2875302-a3a4-41ec-924b-5c7158f85527 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:40.448990 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e2875302-a3a4-41ec-924b-5c7158f85527 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:40.546059 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e2875302-a3a4-41ec-924b-5c7158f85527 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.111967 Nov 19 03:27:40.546767 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 550/1032] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:40 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:41.069497 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-544780092", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f425b87a-bd81-4b76-ae6d-df8730e55965"}], "security_groups": [{"name": "tempest-securitygroup--1627723350"}], "key_name": "tempest-keypair-1949391301", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:41.173774 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.network.neutron [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] validate_networks() for [('f425b87a-bd81-4b76-ae6d-df8730e55965', None, None, None, None, None)] {{(pid=116066) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:27:41.546682 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Flavor limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:27:41.547104 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Image limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:27:41.547574 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Flavor pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:27:41.548001 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Image pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:27:41.548407 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:27:41.557661 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:41.558106 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:41.558265 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0c38c863-a9c7-42eb-a833-0614961d51d9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:41.559003 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:41.559167 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0c38c863-a9c7-42eb-a833-0614961d51d9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:41.559439 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:41.565959 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0c38c863-a9c7-42eb-a833-0614961d51d9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:41.566410 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0c38c863-a9c7-42eb-a833-0614961d51d9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:41.567242 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0c38c863-a9c7-42eb-a833-0614961d51d9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:41.567679 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0c38c863-a9c7-42eb-a833-0614961d51d9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:41.575681 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Getting quotas for project 47d64b0b6d824dcaa62fc05f714c4d3b. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:27:41.579572 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Getting quotas for user 10f233fb185241e8a04f8ce5d27c0bd9 and project 47d64b0b6d824dcaa62fc05f714c4d3b. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:27:41.590958 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Going to run 1 instances... {{(pid=116066) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:27:41.593266 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:27:41.638707 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-56639bc0-609d-4556-91cf-e2a6a506b40a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.573842 Nov 19 03:27:41.639341 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 483/1033] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:27:41 2021] POST /compute/v2.1/servers => generated 402 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:27:41.649338 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-dead5eee-a397-4a4c-9bd1-0fdad10d790a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:41.649945 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-dead5eee-a397-4a4c-9bd1-0fdad10d790a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:41.653659 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0c38c863-a9c7-42eb-a833-0614961d51d9 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.099806 Nov 19 03:27:41.654298 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 551/1034] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:41 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 03:27:41.701980 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-dead5eee-a397-4a4c-9bd1-0fdad10d790a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:41.709792 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-dead5eee-a397-4a4c-9bd1-0fdad10d790a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1237 microversion: 2.1 time: 0.063967 Nov 19 03:27:41.710365 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 484/1035] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:41 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:27:42.667521 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9742732e-6a7c-40cc-b59f-a922ec9048e0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:42.668751 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9742732e-6a7c-40cc-b59f-a922ec9048e0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:42.677257 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9742732e-6a7c-40cc-b59f-a922ec9048e0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:42.677792 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9742732e-6a7c-40cc-b59f-a922ec9048e0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:42.679251 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9742732e-6a7c-40cc-b59f-a922ec9048e0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:42.679682 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9742732e-6a7c-40cc-b59f-a922ec9048e0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:42.726397 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-50ad5f18-dbd8-4bf0-9ced-f40983a9b765 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:42.727068 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-50ad5f18-dbd8-4bf0-9ced-f40983a9b765 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:42.733600 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-50ad5f18-dbd8-4bf0-9ced-f40983a9b765 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:42.734049 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-50ad5f18-dbd8-4bf0-9ced-f40983a9b765 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:42.734859 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-50ad5f18-dbd8-4bf0-9ced-f40983a9b765 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:42.735279 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-50ad5f18-dbd8-4bf0-9ced-f40983a9b765 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:42.769255 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9742732e-6a7c-40cc-b59f-a922ec9048e0 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 28661 microversion: 2.20 time: 0.107248 Nov 19 03:27:42.769926 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 552/1036] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:42 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 28661 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:42.802409 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-50ad5f18-dbd8-4bf0-9ced-f40983a9b765 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:42.810920 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-50ad5f18-dbd8-4bf0-9ced-f40983a9b765 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1307 microversion: 2.1 time: 0.088607 Nov 19 03:27:42.811487 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 485/1037] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:42 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:27:43.781952 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4c0ac916-2b5f-418c-8c84-cae2d1ed9bf3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:43.782900 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4c0ac916-2b5f-418c-8c84-cae2d1ed9bf3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:43.792468 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4c0ac916-2b5f-418c-8c84-cae2d1ed9bf3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:43.792918 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4c0ac916-2b5f-418c-8c84-cae2d1ed9bf3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:43.794340 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4c0ac916-2b5f-418c-8c84-cae2d1ed9bf3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:43.794827 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4c0ac916-2b5f-418c-8c84-cae2d1ed9bf3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:43.827901 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b889e3e2-a281-4b8e-b3c2-39155669d125 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:43.828759 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b889e3e2-a281-4b8e-b3c2-39155669d125 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:43.835740 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b889e3e2-a281-4b8e-b3c2-39155669d125 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:43.836260 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b889e3e2-a281-4b8e-b3c2-39155669d125 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:43.837108 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b889e3e2-a281-4b8e-b3c2-39155669d125 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:43.837609 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b889e3e2-a281-4b8e-b3c2-39155669d125 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:43.893273 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4c0ac916-2b5f-418c-8c84-cae2d1ed9bf3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 29110 microversion: 2.20 time: 0.115290 Nov 19 03:27:43.894331 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 553/1038] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:43 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 29110 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:43.972742 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b889e3e2-a281-4b8e-b3c2-39155669d125 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:43.980903 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b889e3e2-a281-4b8e-b3c2-39155669d125 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1363 microversion: 2.1 time: 0.156700 Nov 19 03:27:43.981576 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 486/1039] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:43 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:27:44.292757 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-cabde2b2-dca6-47d6-8b13-ff015c239068 req-36eb8a4a-e304-41c6-b0f5-c1c9a61bfee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d25e92-7d0e-4a2a-8c3c-b5a5f296c502", "tag": "f7a46174-e8bc-466b-af2e-40c5bc49b38d"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:44.294251 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:27:44.294251 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:27:44.304760 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-cabde2b2-dca6-47d6-8b13-ff015c239068 req-36eb8a4a-e304-41c6-b0f5-c1c9a61bfee2 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:44.305490 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-cabde2b2-dca6-47d6-8b13-ff015c239068 req-36eb8a4a-e304-41c6-b0f5-c1c9a61bfee2 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:44.317538 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-cabde2b2-dca6-47d6-8b13-ff015c239068 req-36eb8a4a-e304-41c6-b0f5-c1c9a61bfee2 service nova] Creating event network-changed:f7a46174-e8bc-466b-af2e-40c5bc49b38d for instance 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 on hv-cinder-81803 Nov 19 03:27:44.323571 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-cabde2b2-dca6-47d6-8b13-ff015c239068 req-36eb8a4a-e304-41c6-b0f5-c1c9a61bfee2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034643 Nov 19 03:27:44.329045 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 554/1040] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:27:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:27:44.906836 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-25035e6b-e1c7-4a56-91fc-82d276c705b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:44.908040 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-25035e6b-e1c7-4a56-91fc-82d276c705b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:44.916375 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-25035e6b-e1c7-4a56-91fc-82d276c705b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:44.916830 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-25035e6b-e1c7-4a56-91fc-82d276c705b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:44.917638 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-25035e6b-e1c7-4a56-91fc-82d276c705b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:44.918246 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-25035e6b-e1c7-4a56-91fc-82d276c705b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:45.000117 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4eeacee3-71ad-46a9-aaae-0736beb757d5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:45.001843 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4eeacee3-71ad-46a9-aaae-0736beb757d5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:45.009162 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4eeacee3-71ad-46a9-aaae-0736beb757d5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:45.009779 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4eeacee3-71ad-46a9-aaae-0736beb757d5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:45.010746 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4eeacee3-71ad-46a9-aaae-0736beb757d5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:45.011367 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4eeacee3-71ad-46a9-aaae-0736beb757d5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:45.155939 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4eeacee3-71ad-46a9-aaae-0736beb757d5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:45.158659 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-25035e6b-e1c7-4a56-91fc-82d276c705b1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 31587 microversion: 2.20 time: 0.255882 Nov 19 03:27:45.162832 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 487/1041] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:44 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 31587 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:45.165005 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4eeacee3-71ad-46a9-aaae-0736beb757d5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1363 microversion: 2.1 time: 0.170154 Nov 19 03:27:45.165577 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 555/1042] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:44 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:27:46.171740 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-50b486be-6120-45c8-9746-a39543d0203c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:46.172731 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-50b486be-6120-45c8-9746-a39543d0203c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:46.180509 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-50b486be-6120-45c8-9746-a39543d0203c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:46.180881 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-50b486be-6120-45c8-9746-a39543d0203c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:46.181481 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b37ad269-adf9-4897-a54e-fff64ecc9a30 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:46.181914 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-50b486be-6120-45c8-9746-a39543d0203c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:46.182065 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-50b486be-6120-45c8-9746-a39543d0203c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:46.182208 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b37ad269-adf9-4897-a54e-fff64ecc9a30 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:46.188260 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b37ad269-adf9-4897-a54e-fff64ecc9a30 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:46.188704 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b37ad269-adf9-4897-a54e-fff64ecc9a30 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:46.189473 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b37ad269-adf9-4897-a54e-fff64ecc9a30 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:46.189905 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b37ad269-adf9-4897-a54e-fff64ecc9a30 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:46.275148 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-50b486be-6120-45c8-9746-a39543d0203c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 32950 microversion: 2.20 time: 0.107234 Nov 19 03:27:46.275919 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 488/1043] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:46 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 32950 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:46.321280 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b37ad269-adf9-4897-a54e-fff64ecc9a30 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:46.328612 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b37ad269-adf9-4897-a54e-fff64ecc9a30 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1363 microversion: 2.1 time: 0.151238 Nov 19 03:27:46.329171 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 556/1044] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:46 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:27:47.287814 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-eb4a52a2-742a-4a36-878b-011f1ec164e7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:47.288832 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-eb4a52a2-742a-4a36-878b-011f1ec164e7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:47.295751 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eb4a52a2-742a-4a36-878b-011f1ec164e7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:47.296194 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eb4a52a2-742a-4a36-878b-011f1ec164e7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:47.296959 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eb4a52a2-742a-4a36-878b-011f1ec164e7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:47.297384 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eb4a52a2-742a-4a36-878b-011f1ec164e7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:47.344882 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-153c655d-f8bf-47e6-a4d7-8e2f7d796744 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:47.345399 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-153c655d-f8bf-47e6-a4d7-8e2f7d796744 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:47.351952 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-153c655d-f8bf-47e6-a4d7-8e2f7d796744 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:47.352406 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-153c655d-f8bf-47e6-a4d7-8e2f7d796744 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:47.353179 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-153c655d-f8bf-47e6-a4d7-8e2f7d796744 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:47.353615 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-153c655d-f8bf-47e6-a4d7-8e2f7d796744 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:47.389417 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-eb4a52a2-742a-4a36-878b-011f1ec164e7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 33960 microversion: 2.20 time: 0.105736 Nov 19 03:27:47.390086 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 489/1045] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:47 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 33960 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:47.487808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-153c655d-f8bf-47e6-a4d7-8e2f7d796744 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:47.495353 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-153c655d-f8bf-47e6-a4d7-8e2f7d796744 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1363 microversion: 2.1 time: 0.154055 Nov 19 03:27:47.495967 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 557/1046] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:47 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:27:48.402903 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-720955ac-51d6-436c-9c7a-d49d3b70dc92 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:48.403918 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-720955ac-51d6-436c-9c7a-d49d3b70dc92 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:48.411632 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-720955ac-51d6-436c-9c7a-d49d3b70dc92 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:48.412073 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-720955ac-51d6-436c-9c7a-d49d3b70dc92 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:48.413412 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-720955ac-51d6-436c-9c7a-d49d3b70dc92 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:48.413836 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-720955ac-51d6-436c-9c7a-d49d3b70dc92 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:48.511967 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ad768414-b9ba-4b09-a5fd-686e6a9d5e4a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:48.512780 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ad768414-b9ba-4b09-a5fd-686e6a9d5e4a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:48.519088 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ad768414-b9ba-4b09-a5fd-686e6a9d5e4a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:48.519698 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ad768414-b9ba-4b09-a5fd-686e6a9d5e4a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:48.520481 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ad768414-b9ba-4b09-a5fd-686e6a9d5e4a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:48.520915 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ad768414-b9ba-4b09-a5fd-686e6a9d5e4a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:48.532679 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-720955ac-51d6-436c-9c7a-d49d3b70dc92 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 35289 microversion: 2.20 time: 0.134311 Nov 19 03:27:48.533330 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 490/1047] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:48 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 35289 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:48.651113 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ad768414-b9ba-4b09-a5fd-686e6a9d5e4a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:48.658297 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ad768414-b9ba-4b09-a5fd-686e6a9d5e4a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1363 microversion: 2.1 time: 0.150027 Nov 19 03:27:48.658834 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 558/1048] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:48 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:27:49.545509 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0f10daab-a936-4264-94d5-0ebba9fb8658 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:49.546559 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0f10daab-a936-4264-94d5-0ebba9fb8658 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:49.553325 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0f10daab-a936-4264-94d5-0ebba9fb8658 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:49.553761 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0f10daab-a936-4264-94d5-0ebba9fb8658 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:49.554537 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0f10daab-a936-4264-94d5-0ebba9fb8658 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:49.554964 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0f10daab-a936-4264-94d5-0ebba9fb8658 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:49.644770 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0f10daab-a936-4264-94d5-0ebba9fb8658 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 36825 microversion: 2.20 time: 0.103062 Nov 19 03:27:49.645427 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 491/1049] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:49 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 36825 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:49.675999 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-89e1164b-c7b3-4bcd-ac74-0e3df52b88e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:49.676739 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-89e1164b-c7b3-4bcd-ac74-0e3df52b88e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:49.683760 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89e1164b-c7b3-4bcd-ac74-0e3df52b88e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:49.684217 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89e1164b-c7b3-4bcd-ac74-0e3df52b88e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:49.685008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89e1164b-c7b3-4bcd-ac74-0e3df52b88e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:49.685440 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-89e1164b-c7b3-4bcd-ac74-0e3df52b88e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:49.825303 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-89e1164b-c7b3-4bcd-ac74-0e3df52b88e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:49.832659 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-89e1164b-c7b3-4bcd-ac74-0e3df52b88e0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1363 microversion: 2.1 time: 0.160312 Nov 19 03:27:49.833249 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 559/1050] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:49 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:27:49.848986 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-07894caa-7b90-4a5c-80dd-b00233cb04e2 req-c2ce20d2-b890-4546-bdd0-b277c8668e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d25e92-7d0e-4a2a-8c3c-b5a5f296c502", "name": "network-vif-plugged", "status": "completed", "tag": "f7a46174-e8bc-466b-af2e-40c5bc49b38d"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:49.850372 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:27:49.850372 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:27:49.858373 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-07894caa-7b90-4a5c-80dd-b00233cb04e2 req-c2ce20d2-b890-4546-bdd0-b277c8668e92 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:49.858845 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-07894caa-7b90-4a5c-80dd-b00233cb04e2 req-c2ce20d2-b890-4546-bdd0-b277c8668e92 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:49.870762 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-07894caa-7b90-4a5c-80dd-b00233cb04e2 req-c2ce20d2-b890-4546-bdd0-b277c8668e92 service nova] Creating event network-vif-plugged:f7a46174-e8bc-466b-af2e-40c5bc49b38d for instance 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 on hv-cinder-81803 Nov 19 03:27:49.875410 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-07894caa-7b90-4a5c-80dd-b00233cb04e2 req-c2ce20d2-b890-4546-bdd0-b277c8668e92 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030540 Nov 19 03:27:49.876036 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 492/1051] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:27:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:27:50.657748 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-963b65ed-031f-4429-aa4f-e13ab82c2e73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:50.658689 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-963b65ed-031f-4429-aa4f-e13ab82c2e73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:50.665412 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-963b65ed-031f-4429-aa4f-e13ab82c2e73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:50.665858 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-963b65ed-031f-4429-aa4f-e13ab82c2e73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:50.666660 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-963b65ed-031f-4429-aa4f-e13ab82c2e73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:50.667091 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-963b65ed-031f-4429-aa4f-e13ab82c2e73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:50.768043 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-963b65ed-031f-4429-aa4f-e13ab82c2e73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 38215 microversion: 2.20 time: 0.113814 Nov 19 03:27:50.768691 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 560/1052] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:50 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 38215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:50.851138 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0a521002-2952-4ff2-af0c-b3ffbe81399f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:50.851842 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0a521002-2952-4ff2-af0c-b3ffbe81399f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:50.857962 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a521002-2952-4ff2-af0c-b3ffbe81399f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:50.858406 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a521002-2952-4ff2-af0c-b3ffbe81399f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:50.859212 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a521002-2952-4ff2-af0c-b3ffbe81399f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:50.859644 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0a521002-2952-4ff2-af0c-b3ffbe81399f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:50.989977 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0a521002-2952-4ff2-af0c-b3ffbe81399f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:50.997809 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0a521002-2952-4ff2-af0c-b3ffbe81399f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1363 microversion: 2.1 time: 0.151858 Nov 19 03:27:50.998374 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 493/1053] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:50 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:27:51.781061 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-48755089-867b-4a87-a39d-3056b6bb901d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:51.782080 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-48755089-867b-4a87-a39d-3056b6bb901d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:51.789281 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-48755089-867b-4a87-a39d-3056b6bb901d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:51.789724 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-48755089-867b-4a87-a39d-3056b6bb901d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:51.790505 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-48755089-867b-4a87-a39d-3056b6bb901d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:51.790940 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-48755089-867b-4a87-a39d-3056b6bb901d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:51.873053 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-48755089-867b-4a87-a39d-3056b6bb901d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 38215 microversion: 2.20 time: 0.095921 Nov 19 03:27:51.873674 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 561/1054] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:51 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 38215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:52.014353 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-eb681f1c-005d-4db2-9ae1-b74eb9049645 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:52.015002 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-eb681f1c-005d-4db2-9ae1-b74eb9049645 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:52.021263 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eb681f1c-005d-4db2-9ae1-b74eb9049645 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:52.021750 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eb681f1c-005d-4db2-9ae1-b74eb9049645 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:52.023246 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eb681f1c-005d-4db2-9ae1-b74eb9049645 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:52.023684 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-eb681f1c-005d-4db2-9ae1-b74eb9049645 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:52.157498 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-eb681f1c-005d-4db2-9ae1-b74eb9049645 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:52.165122 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-eb681f1c-005d-4db2-9ae1-b74eb9049645 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1550 microversion: 2.1 time: 0.154471 Nov 19 03:27:52.165717 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 494/1055] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:27:52 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:27:52.182294 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-dd15c704-0915-4f88-abf8-5e903d94e878 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:52.182898 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-dd15c704-0915-4f88-abf8-5e903d94e878 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:52.189700 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd15c704-0915-4f88-abf8-5e903d94e878 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:52.190141 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd15c704-0915-4f88-abf8-5e903d94e878 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:52.190928 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd15c704-0915-4f88-abf8-5e903d94e878 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:52.191359 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-dd15c704-0915-4f88-abf8-5e903d94e878 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:52.274154 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-dd15c704-0915-4f88-abf8-5e903d94e878 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096488 Nov 19 03:27:52.274789 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 562/1056] 10.222.0.47 () {58 vars in 1274 bytes} [Fri Nov 19 03:27:52 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:27:52.884767 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d27378f2-f208-4cb1-ae22-07e7e8948cd7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:52.885680 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d27378f2-f208-4cb1-ae22-07e7e8948cd7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:52.891952 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d27378f2-f208-4cb1-ae22-07e7e8948cd7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:52.892402 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d27378f2-f208-4cb1-ae22-07e7e8948cd7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:52.893179 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d27378f2-f208-4cb1-ae22-07e7e8948cd7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:52.893616 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d27378f2-f208-4cb1-ae22-07e7e8948cd7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:52.978645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d27378f2-f208-4cb1-ae22-07e7e8948cd7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 38215 microversion: 2.20 time: 0.097343 Nov 19 03:27:52.982734 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 495/1057] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:52 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 38215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:53.210356 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-481be171-ba42-45e5-8e86-e8430e734a8c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:53.211461 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-481be171-ba42-45e5-8e86-e8430e734a8c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:53.217564 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-481be171-ba42-45e5-8e86-e8430e734a8c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:53.218008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-481be171-ba42-45e5-8e86-e8430e734a8c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:53.218121 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-7eaaf8c6-5d28-426e-8913-81873331eed6 req-f5e6fe5e-4a98-4bb4-a148-4837003091f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d25e92-7d0e-4a2a-8c3c-b5a5f296c502", "tag": "f7a46174-e8bc-466b-af2e-40c5bc49b38d"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:53.218957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-481be171-ba42-45e5-8e86-e8430e734a8c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:53.219381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-481be171-ba42-45e5-8e86-e8430e734a8c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:53.219643 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:27:53.219643 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:27:53.227937 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-7eaaf8c6-5d28-426e-8913-81873331eed6 req-f5e6fe5e-4a98-4bb4-a148-4837003091f9 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:53.228384 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-7eaaf8c6-5d28-426e-8913-81873331eed6 req-f5e6fe5e-4a98-4bb4-a148-4837003091f9 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:53.239789 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-7eaaf8c6-5d28-426e-8913-81873331eed6 req-f5e6fe5e-4a98-4bb4-a148-4837003091f9 service nova] Creating event network-changed:f7a46174-e8bc-466b-af2e-40c5bc49b38d for instance 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 on hv-cinder-81803 Nov 19 03:27:53.244766 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-7eaaf8c6-5d28-426e-8913-81873331eed6 req-f5e6fe5e-4a98-4bb4-a148-4837003091f9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030335 Nov 19 03:27:53.245585 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 496/1058] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:27:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:27:53.328029 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-481be171-ba42-45e5-8e86-e8430e734a8c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 14 microversion: 2.1 time: 0.122143 Nov 19 03:27:53.328914 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 563/1059] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:27:53 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:27:53.992199 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f686b338-6063-47cb-beb9-f09d566f4f70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:53.993206 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f686b338-6063-47cb-beb9-f09d566f4f70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:53.999582 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f686b338-6063-47cb-beb9-f09d566f4f70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:54.000032 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f686b338-6063-47cb-beb9-f09d566f4f70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:54.000820 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f686b338-6063-47cb-beb9-f09d566f4f70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:54.001255 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f686b338-6063-47cb-beb9-f09d566f4f70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:54.087365 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f686b338-6063-47cb-beb9-f09d566f4f70 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 38215 microversion: 2.20 time: 0.100093 Nov 19 03:27:54.087779 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 497/1060] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:53 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 38215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:54.339783 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c5123ae8-7b4c-487f-b1ab-e55caf0e3fa9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:54.340821 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c5123ae8-7b4c-487f-b1ab-e55caf0e3fa9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:54.347865 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c5123ae8-7b4c-487f-b1ab-e55caf0e3fa9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:54.348316 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c5123ae8-7b4c-487f-b1ab-e55caf0e3fa9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:54.349146 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c5123ae8-7b4c-487f-b1ab-e55caf0e3fa9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:54.349578 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c5123ae8-7b4c-487f-b1ab-e55caf0e3fa9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:54.428954 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c5123ae8-7b4c-487f-b1ab-e55caf0e3fa9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 14 microversion: 2.1 time: 0.093178 Nov 19 03:27:54.429737 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 564/1061] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:27:54 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:27:55.099145 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-65ff742c-f09d-41ed-95f0-3a6bcb1ebb5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:55.100307 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-65ff742c-f09d-41ed-95f0-3a6bcb1ebb5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:55.107090 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-65ff742c-f09d-41ed-95f0-3a6bcb1ebb5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:55.107529 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-65ff742c-f09d-41ed-95f0-3a6bcb1ebb5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:55.108290 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-65ff742c-f09d-41ed-95f0-3a6bcb1ebb5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:55.108717 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-65ff742c-f09d-41ed-95f0-3a6bcb1ebb5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:55.206603 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-65ff742c-f09d-41ed-95f0-3a6bcb1ebb5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 200 len: 38356 microversion: 2.20 time: 0.111246 Nov 19 03:27:55.207277 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 498/1062] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:55 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 38356 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:27:55.217700 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8edbb7af-91a9-48f6-b76b-5f55647717d8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:55.218281 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8edbb7af-91a9-48f6-b76b-5f55647717d8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:55.225167 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8edbb7af-91a9-48f6-b76b-5f55647717d8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:55.225623 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8edbb7af-91a9-48f6-b76b-5f55647717d8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:55.226387 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8edbb7af-91a9-48f6-b76b-5f55647717d8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:55.226853 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8edbb7af-91a9-48f6-b76b-5f55647717d8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:55.250035 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8edbb7af-91a9-48f6-b76b-5f55647717d8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/ips" status: 200 len: 151 microversion: 2.20 time: 0.036381 Nov 19 03:27:55.250607 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 565/1063] 10.222.0.47 () {60 vars in 1288 bytes} [Fri Nov 19 03:27:55 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:27:55.444385 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b08559ff-8f6a-4408-9756-92f439b77d51 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:55.444385 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b08559ff-8f6a-4408-9756-92f439b77d51 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:55.453481 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b08559ff-8f6a-4408-9756-92f439b77d51 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:55.454340 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b08559ff-8f6a-4408-9756-92f439b77d51 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:55.454796 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b08559ff-8f6a-4408-9756-92f439b77d51 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:55.455399 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b08559ff-8f6a-4408-9756-92f439b77d51 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:55.559190 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b08559ff-8f6a-4408-9756-92f439b77d51 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 14 microversion: 2.1 time: 0.123112 Nov 19 03:27:55.559855 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 499/1064] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:27:55 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:27:56.568904 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-07dbe051-b040-4456-94a9-10f1844bb345 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:56.569873 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-07dbe051-b040-4456-94a9-10f1844bb345 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:56.576898 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-07dbe051-b040-4456-94a9-10f1844bb345 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:56.577337 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-07dbe051-b040-4456-94a9-10f1844bb345 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:56.578102 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-07dbe051-b040-4456-94a9-10f1844bb345 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:56.578570 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-07dbe051-b040-4456-94a9-10f1844bb345 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:56.658711 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-07dbe051-b040-4456-94a9-10f1844bb345 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 14 microversion: 2.1 time: 0.093206 Nov 19 03:27:56.659370 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 566/1065] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:27:56 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:27:57.335720 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-84cb4cdb-e87c-4f1e-adaf-5effd24982d2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:57.337025 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-84cb4cdb-e87c-4f1e-adaf-5effd24982d2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:57.343886 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-84cb4cdb-e87c-4f1e-adaf-5effd24982d2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:57.344322 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-84cb4cdb-e87c-4f1e-adaf-5effd24982d2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:57.345078 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-84cb4cdb-e87c-4f1e-adaf-5effd24982d2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:57.345500 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-84cb4cdb-e87c-4f1e-adaf-5effd24982d2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:57.368043 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.objects.instance [None req-84cb4cdb-e87c-4f1e-adaf-5effd24982d2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lazy-loading 'flavor' on Instance uuid 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba {{(pid=116066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:27:57.627422 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-84cb4cdb-e87c-4f1e-adaf-5effd24982d2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 202 len: 0 microversion: 2.20 time: 0.295626 Nov 19 03:27:57.628030 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 500/1066] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:27:57 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:27:57.637091 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-23044944-92f2-420a-b209-4e86edf7dd3c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:57.637781 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-23044944-92f2-420a-b209-4e86edf7dd3c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:57.646077 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-23044944-92f2-420a-b209-4e86edf7dd3c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:57.646619 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-23044944-92f2-420a-b209-4e86edf7dd3c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:57.647480 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-23044944-92f2-420a-b209-4e86edf7dd3c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:57.647907 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-23044944-92f2-420a-b209-4e86edf7dd3c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:57.670104 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9f37e878-f536-4500-9e57-6c4291108660 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:57.671408 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9f37e878-f536-4500-9e57-6c4291108660 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:57.677634 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9f37e878-f536-4500-9e57-6c4291108660 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:57.678064 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9f37e878-f536-4500-9e57-6c4291108660 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:57.678879 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9f37e878-f536-4500-9e57-6c4291108660 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:57.679308 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9f37e878-f536-4500-9e57-6c4291108660 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:57.778899 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9f37e878-f536-4500-9e57-6c4291108660 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 14 microversion: 2.1 time: 0.112519 Nov 19 03:27:57.779565 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 501/1067] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:27:57 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 03:27:57.780486 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-23044944-92f2-420a-b209-4e86edf7dd3c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:57.788858 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-23044944-92f2-420a-b209-4e86edf7dd3c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:57.790842 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-23044944-92f2-420a-b209-4e86edf7dd3c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:57.791974 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-23044944-92f2-420a-b209-4e86edf7dd3c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1723 microversion: 2.20 time: 0.159636 Nov 19 03:27:57.792511 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 567/1068] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:27:57 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:27:58.790336 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cfc983c5-5ef4-455f-b242-8bd06490bfad tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:58.791345 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-cfc983c5-5ef4-455f-b242-8bd06490bfad tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:58.798093 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cfc983c5-5ef4-455f-b242-8bd06490bfad tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:58.798572 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cfc983c5-5ef4-455f-b242-8bd06490bfad tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:58.799332 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cfc983c5-5ef4-455f-b242-8bd06490bfad tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:58.799755 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cfc983c5-5ef4-455f-b242-8bd06490bfad tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:58.809143 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-adff0999-c928-4b97-96ec-92f1c2088707 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:58.809742 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-adff0999-c928-4b97-96ec-92f1c2088707 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:58.816036 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-adff0999-c928-4b97-96ec-92f1c2088707 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:58.816474 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-adff0999-c928-4b97-96ec-92f1c2088707 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:58.817239 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-adff0999-c928-4b97-96ec-92f1c2088707 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:58.817666 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-adff0999-c928-4b97-96ec-92f1c2088707 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:58.893496 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cfc983c5-5ef4-455f-b242-8bd06490bfad tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 14 microversion: 2.1 time: 0.107275 Nov 19 03:27:58.897624 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 502/1069] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:27:58 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 03:27:58.950693 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-adff0999-c928-4b97-96ec-92f1c2088707 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:58.958247 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-adff0999-c928-4b97-96ec-92f1c2088707 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:58.959743 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-adff0999-c928-4b97-96ec-92f1c2088707 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:27:58.960906 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-adff0999-c928-4b97-96ec-92f1c2088707 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1723 microversion: 2.20 time: 0.155317 Nov 19 03:27:58.961762 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 568/1070] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:27:58 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:27:59.905829 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e0d9e36d-3843-48c4-8e4f-d736e1e7f31c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:27:59.906846 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e0d9e36d-3843-48c4-8e4f-d736e1e7f31c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:59.913883 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e0d9e36d-3843-48c4-8e4f-d736e1e7f31c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:59.914847 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e0d9e36d-3843-48c4-8e4f-d736e1e7f31c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:59.915789 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e0d9e36d-3843-48c4-8e4f-d736e1e7f31c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:59.916426 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e0d9e36d-3843-48c4-8e4f-d736e1e7f31c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:59.979203 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-63440a3a-df68-495b-8091-b042d213979c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:27:59.979837 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-63440a3a-df68-495b-8091-b042d213979c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:27:59.986061 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-63440a3a-df68-495b-8091-b042d213979c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:59.986539 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-63440a3a-df68-495b-8091-b042d213979c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:59.987315 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-63440a3a-df68-495b-8091-b042d213979c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:27:59.987753 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-63440a3a-df68-495b-8091-b042d213979c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:27:59.995711 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e0d9e36d-3843-48c4-8e4f-d736e1e7f31c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 14 microversion: 2.1 time: 0.093744 Nov 19 03:27:59.999611 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 503/1071] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:27:59 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:28:00.116825 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-63440a3a-df68-495b-8091-b042d213979c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:00.124673 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-63440a3a-df68-495b-8091-b042d213979c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:00.126155 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-63440a3a-df68-495b-8091-b042d213979c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:00.127337 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-63440a3a-df68-495b-8091-b042d213979c tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1723 microversion: 2.20 time: 0.151818 Nov 19 03:28:00.127908 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 569/1072] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:27:59 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:01.007511 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-71e42e2c-f0df-4773-8ed2-db96c6e160a3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:01.008507 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-71e42e2c-f0df-4773-8ed2-db96c6e160a3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:01.015310 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-71e42e2c-f0df-4773-8ed2-db96c6e160a3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:01.015753 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-71e42e2c-f0df-4773-8ed2-db96c6e160a3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:01.016509 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-71e42e2c-f0df-4773-8ed2-db96c6e160a3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:01.016939 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-71e42e2c-f0df-4773-8ed2-db96c6e160a3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:01.110287 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-71e42e2c-f0df-4773-8ed2-db96c6e160a3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 14 microversion: 2.1 time: 0.106558 Nov 19 03:28:01.111118 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 504/1073] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:01 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:28:01.144834 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a7ed44d1-9898-4baa-a0e8-97b1340f2908 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:01.145455 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a7ed44d1-9898-4baa-a0e8-97b1340f2908 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:01.152239 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a7ed44d1-9898-4baa-a0e8-97b1340f2908 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:01.152677 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a7ed44d1-9898-4baa-a0e8-97b1340f2908 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:01.153436 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a7ed44d1-9898-4baa-a0e8-97b1340f2908 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:01.153864 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a7ed44d1-9898-4baa-a0e8-97b1340f2908 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:01.281653 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a7ed44d1-9898-4baa-a0e8-97b1340f2908 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:01.290422 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a7ed44d1-9898-4baa-a0e8-97b1340f2908 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:01.292425 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a7ed44d1-9898-4baa-a0e8-97b1340f2908 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:01.293594 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a7ed44d1-9898-4baa-a0e8-97b1340f2908 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1723 microversion: 2.20 time: 0.152360 Nov 19 03:28:01.294290 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 570/1074] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:01 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:02.122287 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-622f9d13-d0c1-4f82-9aed-cfc1a26e4633 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:02.123306 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-622f9d13-d0c1-4f82-9aed-cfc1a26e4633 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:02.130140 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-622f9d13-d0c1-4f82-9aed-cfc1a26e4633 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:02.130697 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-622f9d13-d0c1-4f82-9aed-cfc1a26e4633 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:02.131464 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-622f9d13-d0c1-4f82-9aed-cfc1a26e4633 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:02.131893 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-622f9d13-d0c1-4f82-9aed-cfc1a26e4633 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:02.213908 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-622f9d13-d0c1-4f82-9aed-cfc1a26e4633 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 14 microversion: 2.1 time: 0.096306 Nov 19 03:28:02.214546 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 505/1075] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:02 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:28:02.311648 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8dbb8ed4-eacf-42ba-8b52-568e1d64bf73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:02.312256 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8dbb8ed4-eacf-42ba-8b52-568e1d64bf73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:02.318591 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8dbb8ed4-eacf-42ba-8b52-568e1d64bf73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:02.319039 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8dbb8ed4-eacf-42ba-8b52-568e1d64bf73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:02.319808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8dbb8ed4-eacf-42ba-8b52-568e1d64bf73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:02.320263 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8dbb8ed4-eacf-42ba-8b52-568e1d64bf73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:02.450253 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8dbb8ed4-eacf-42ba-8b52-568e1d64bf73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:02.457967 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8dbb8ed4-eacf-42ba-8b52-568e1d64bf73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:02.459478 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8dbb8ed4-eacf-42ba-8b52-568e1d64bf73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:02.460626 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8dbb8ed4-eacf-42ba-8b52-568e1d64bf73 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1723 microversion: 2.20 time: 0.152722 Nov 19 03:28:02.461406 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 571/1076] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:02 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:03.224721 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b06b74ea-d15c-4ec5-8e58-5fdcb9d4e34c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:03.225723 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b06b74ea-d15c-4ec5-8e58-5fdcb9d4e34c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:03.232720 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b06b74ea-d15c-4ec5-8e58-5fdcb9d4e34c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:03.233162 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b06b74ea-d15c-4ec5-8e58-5fdcb9d4e34c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:03.233927 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b06b74ea-d15c-4ec5-8e58-5fdcb9d4e34c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:03.234355 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b06b74ea-d15c-4ec5-8e58-5fdcb9d4e34c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:03.327996 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b06b74ea-d15c-4ec5-8e58-5fdcb9d4e34c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 14 microversion: 2.1 time: 0.106995 Nov 19 03:28:03.328548 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 506/1077] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:03 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:28:03.478962 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d529c6b2-c78c-4e60-aeac-97f837909a95 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:03.479567 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d529c6b2-c78c-4e60-aeac-97f837909a95 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:03.485851 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d529c6b2-c78c-4e60-aeac-97f837909a95 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:03.486294 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d529c6b2-c78c-4e60-aeac-97f837909a95 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:03.487099 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d529c6b2-c78c-4e60-aeac-97f837909a95 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:03.487536 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d529c6b2-c78c-4e60-aeac-97f837909a95 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:03.622938 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d529c6b2-c78c-4e60-aeac-97f837909a95 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:03.630623 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d529c6b2-c78c-4e60-aeac-97f837909a95 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:03.632108 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d529c6b2-c78c-4e60-aeac-97f837909a95 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:03.633907 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d529c6b2-c78c-4e60-aeac-97f837909a95 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1723 microversion: 2.20 time: 0.159077 Nov 19 03:28:03.634479 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 572/1078] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:03 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:04.340482 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cc96518b-35da-4b7f-aeff-c38f7ea7fcc6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:04.341791 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-cc96518b-35da-4b7f-aeff-c38f7ea7fcc6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:04.348399 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cc96518b-35da-4b7f-aeff-c38f7ea7fcc6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:04.348844 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cc96518b-35da-4b7f-aeff-c38f7ea7fcc6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:04.349620 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cc96518b-35da-4b7f-aeff-c38f7ea7fcc6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:04.350048 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cc96518b-35da-4b7f-aeff-c38f7ea7fcc6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:04.445820 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cc96518b-35da-4b7f-aeff-c38f7ea7fcc6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 10893 microversion: 2.1 time: 0.110170 Nov 19 03:28:04.447126 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 507/1079] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:04 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 10893 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:04.652848 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-eb87d65c-a86e-483d-83ad-09b42b78ff5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:04.653364 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-eb87d65c-a86e-483d-83ad-09b42b78ff5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:04.659607 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eb87d65c-a86e-483d-83ad-09b42b78ff5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:04.660054 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eb87d65c-a86e-483d-83ad-09b42b78ff5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:04.660821 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eb87d65c-a86e-483d-83ad-09b42b78ff5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:04.661251 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-eb87d65c-a86e-483d-83ad-09b42b78ff5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:04.792563 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-eb87d65c-a86e-483d-83ad-09b42b78ff5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:04.800207 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-eb87d65c-a86e-483d-83ad-09b42b78ff5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:04.801693 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-eb87d65c-a86e-483d-83ad-09b42b78ff5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:04.802859 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-eb87d65c-a86e-483d-83ad-09b42b78ff5d tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1723 microversion: 2.20 time: 0.154724 Nov 19 03:28:04.803428 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 573/1080] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:04 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:05.458067 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cd8aa3b2-cac5-4c6d-a573-e8a9ae701801 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:05.459129 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-cd8aa3b2-cac5-4c6d-a573-e8a9ae701801 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:05.466025 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cd8aa3b2-cac5-4c6d-a573-e8a9ae701801 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:05.466489 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cd8aa3b2-cac5-4c6d-a573-e8a9ae701801 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:05.467265 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cd8aa3b2-cac5-4c6d-a573-e8a9ae701801 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:05.467695 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cd8aa3b2-cac5-4c6d-a573-e8a9ae701801 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:05.560368 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cd8aa3b2-cac5-4c6d-a573-e8a9ae701801 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 17861 microversion: 2.1 time: 0.106141 Nov 19 03:28:05.561053 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 508/1081] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:05 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 17861 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:05.822218 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c7d18d3c-2346-44b9-8b48-c63738bd4369 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:05.822799 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c7d18d3c-2346-44b9-8b48-c63738bd4369 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:05.828956 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c7d18d3c-2346-44b9-8b48-c63738bd4369 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:05.829412 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c7d18d3c-2346-44b9-8b48-c63738bd4369 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:05.830162 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c7d18d3c-2346-44b9-8b48-c63738bd4369 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:05.830627 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c7d18d3c-2346-44b9-8b48-c63738bd4369 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:05.963876 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c7d18d3c-2346-44b9-8b48-c63738bd4369 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:05.972538 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c7d18d3c-2346-44b9-8b48-c63738bd4369 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:05.974283 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c7d18d3c-2346-44b9-8b48-c63738bd4369 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:05.976198 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c7d18d3c-2346-44b9-8b48-c63738bd4369 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1723 microversion: 2.20 time: 0.158147 Nov 19 03:28:05.976760 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 574/1082] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:05 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:06.571905 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9f8bc679-d9ad-4bd3-ac74-f2d507f5722a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:06.572907 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9f8bc679-d9ad-4bd3-ac74-f2d507f5722a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:06.579733 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9f8bc679-d9ad-4bd3-ac74-f2d507f5722a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:06.580177 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9f8bc679-d9ad-4bd3-ac74-f2d507f5722a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:06.580943 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9f8bc679-d9ad-4bd3-ac74-f2d507f5722a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:06.581370 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9f8bc679-d9ad-4bd3-ac74-f2d507f5722a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:06.692845 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9f8bc679-d9ad-4bd3-ac74-f2d507f5722a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 19133 microversion: 2.1 time: 0.124949 Nov 19 03:28:06.693514 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 509/1083] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:06 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 19133 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:06.997645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-391414de-2441-46b2-987d-305cda59443a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:06.998249 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-391414de-2441-46b2-987d-305cda59443a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:07.004618 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-391414de-2441-46b2-987d-305cda59443a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:07.005065 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-391414de-2441-46b2-987d-305cda59443a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:07.005829 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-391414de-2441-46b2-987d-305cda59443a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:07.006260 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-391414de-2441-46b2-987d-305cda59443a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:07.137694 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-391414de-2441-46b2-987d-305cda59443a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:07.145293 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-391414de-2441-46b2-987d-305cda59443a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:07.146874 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-391414de-2441-46b2-987d-305cda59443a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:07.148012 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-391414de-2441-46b2-987d-305cda59443a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1723 microversion: 2.20 time: 0.154671 Nov 19 03:28:07.148586 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 575/1084] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:06 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:07.706038 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-92faa63a-2bcb-4b6d-b7ca-a4142787167b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:07.707066 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-92faa63a-2bcb-4b6d-b7ca-a4142787167b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:07.714077 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-92faa63a-2bcb-4b6d-b7ca-a4142787167b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:07.714552 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-92faa63a-2bcb-4b6d-b7ca-a4142787167b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:07.715330 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-92faa63a-2bcb-4b6d-b7ca-a4142787167b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:07.715762 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-92faa63a-2bcb-4b6d-b7ca-a4142787167b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:07.818242 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-92faa63a-2bcb-4b6d-b7ca-a4142787167b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 21674 microversion: 2.1 time: 0.116698 Nov 19 03:28:07.818911 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 510/1085] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:07 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 21674 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:08.166770 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-22787f4c-f93e-4184-86eb-773771769c28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:08.167426 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-22787f4c-f93e-4184-86eb-773771769c28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:08.173480 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-22787f4c-f93e-4184-86eb-773771769c28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:08.173930 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-22787f4c-f93e-4184-86eb-773771769c28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:08.174742 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-22787f4c-f93e-4184-86eb-773771769c28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:08.175177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-22787f4c-f93e-4184-86eb-773771769c28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:08.307031 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-22787f4c-f93e-4184-86eb-773771769c28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:08.314839 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-22787f4c-f93e-4184-86eb-773771769c28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:08.316321 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-22787f4c-f93e-4184-86eb-773771769c28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:08.317482 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-22787f4c-f93e-4184-86eb-773771769c28 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1723 microversion: 2.20 time: 0.154539 Nov 19 03:28:08.318039 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 576/1086] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:08 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:08.829736 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c77451b9-4068-4ed8-99df-17c2ad3c475c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:08.830776 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c77451b9-4068-4ed8-99df-17c2ad3c475c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:08.837282 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c77451b9-4068-4ed8-99df-17c2ad3c475c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:08.837721 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c77451b9-4068-4ed8-99df-17c2ad3c475c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:08.838517 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c77451b9-4068-4ed8-99df-17c2ad3c475c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:08.838940 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c77451b9-4068-4ed8-99df-17c2ad3c475c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:08.952567 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c77451b9-4068-4ed8-99df-17c2ad3c475c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 23227 microversion: 2.1 time: 0.126741 Nov 19 03:28:08.953214 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 511/1087] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:08 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 23227 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:09.336460 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c131f45f-d1b8-4092-8aef-170ea382b0b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:09.337610 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c131f45f-d1b8-4092-8aef-170ea382b0b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:09.343995 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c131f45f-d1b8-4092-8aef-170ea382b0b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:09.344442 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c131f45f-d1b8-4092-8aef-170ea382b0b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:09.345218 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c131f45f-d1b8-4092-8aef-170ea382b0b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:09.345657 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c131f45f-d1b8-4092-8aef-170ea382b0b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:09.473556 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c131f45f-d1b8-4092-8aef-170ea382b0b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:09.481811 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c131f45f-d1b8-4092-8aef-170ea382b0b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:09.483312 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c131f45f-d1b8-4092-8aef-170ea382b0b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:09.484455 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c131f45f-d1b8-4092-8aef-170ea382b0b7 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1744 microversion: 2.20 time: 0.151707 Nov 19 03:28:09.485018 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 577/1088] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:09 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:09.964830 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6f4eb254-3856-4973-a492-738db61a483f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:09.965829 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6f4eb254-3856-4973-a492-738db61a483f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:09.972740 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6f4eb254-3856-4973-a492-738db61a483f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:09.973187 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6f4eb254-3856-4973-a492-738db61a483f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:09.973960 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6f4eb254-3856-4973-a492-738db61a483f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:09.974394 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6f4eb254-3856-4973-a492-738db61a483f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:10.067926 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6f4eb254-3856-4973-a492-738db61a483f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 23803 microversion: 2.1 time: 0.107679 Nov 19 03:28:10.068788 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 512/1089] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:09 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 23803 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:10.502129 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-017ac33a-d128-4526-8936-1d30622bbf7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:10.502742 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-017ac33a-d128-4526-8936-1d30622bbf7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:10.509181 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-017ac33a-d128-4526-8936-1d30622bbf7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:10.509634 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-017ac33a-d128-4526-8936-1d30622bbf7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:10.510402 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-017ac33a-d128-4526-8936-1d30622bbf7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:10.510859 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-017ac33a-d128-4526-8936-1d30622bbf7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:10.646175 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-017ac33a-d128-4526-8936-1d30622bbf7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:10.653868 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-017ac33a-d128-4526-8936-1d30622bbf7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:10.655386 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-017ac33a-d128-4526-8936-1d30622bbf7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:10.656497 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-017ac33a-d128-4526-8936-1d30622bbf7f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1744 microversion: 2.20 time: 0.158124 Nov 19 03:28:10.657042 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 578/1090] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:10 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:11.080626 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-df1e1184-af62-486a-991e-b25655aa3651 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:11.081621 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-df1e1184-af62-486a-991e-b25655aa3651 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:11.089058 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-df1e1184-af62-486a-991e-b25655aa3651 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:11.089504 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-df1e1184-af62-486a-991e-b25655aa3651 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:11.090276 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-df1e1184-af62-486a-991e-b25655aa3651 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:11.090739 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-df1e1184-af62-486a-991e-b25655aa3651 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:11.191941 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-df1e1184-af62-486a-991e-b25655aa3651 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 24146 microversion: 2.1 time: 0.115178 Nov 19 03:28:11.192558 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 513/1091] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:11 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 24146 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:11.675569 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-74666c90-55fc-4fb7-b9d1-fb7fb8c962bf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:11.676294 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-74666c90-55fc-4fb7-b9d1-fb7fb8c962bf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:11.683208 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-74666c90-55fc-4fb7-b9d1-fb7fb8c962bf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:11.683651 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-74666c90-55fc-4fb7-b9d1-fb7fb8c962bf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:11.684431 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-74666c90-55fc-4fb7-b9d1-fb7fb8c962bf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:11.684862 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-74666c90-55fc-4fb7-b9d1-fb7fb8c962bf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:11.822808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-74666c90-55fc-4fb7-b9d1-fb7fb8c962bf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:11.830494 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-74666c90-55fc-4fb7-b9d1-fb7fb8c962bf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:11.831947 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-74666c90-55fc-4fb7-b9d1-fb7fb8c962bf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:11.833084 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-74666c90-55fc-4fb7-b9d1-fb7fb8c962bf tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1744 microversion: 2.20 time: 0.161286 Nov 19 03:28:11.833644 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 579/1092] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:11 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:12.203929 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b3820b52-fecb-4623-ae92-eebe1150846d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:12.204929 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b3820b52-fecb-4623-ae92-eebe1150846d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:12.211728 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b3820b52-fecb-4623-ae92-eebe1150846d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:12.212927 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b3820b52-fecb-4623-ae92-eebe1150846d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:12.213700 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b3820b52-fecb-4623-ae92-eebe1150846d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:12.214133 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b3820b52-fecb-4623-ae92-eebe1150846d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:12.310720 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b3820b52-fecb-4623-ae92-eebe1150846d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 25400 microversion: 2.1 time: 0.110569 Nov 19 03:28:12.311414 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 514/1093] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:12 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 25400 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:28:12.851505 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e25f19bb-1b1a-4b73-85b1-b64fb23e879f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:12.852106 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e25f19bb-1b1a-4b73-85b1-b64fb23e879f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:12.858943 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e25f19bb-1b1a-4b73-85b1-b64fb23e879f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:12.859389 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e25f19bb-1b1a-4b73-85b1-b64fb23e879f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:12.860162 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e25f19bb-1b1a-4b73-85b1-b64fb23e879f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:12.860593 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e25f19bb-1b1a-4b73-85b1-b64fb23e879f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:12.995485 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e25f19bb-1b1a-4b73-85b1-b64fb23e879f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:13.003212 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e25f19bb-1b1a-4b73-85b1-b64fb23e879f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:13.004683 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e25f19bb-1b1a-4b73-85b1-b64fb23e879f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:13.005822 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e25f19bb-1b1a-4b73-85b1-b64fb23e879f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1744 microversion: 2.20 time: 0.158024 Nov 19 03:28:13.006373 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 580/1094] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:12 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:13.322844 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-27b87e22-d269-4fa6-aa90-d965c91c7b44 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:13.323830 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-27b87e22-d269-4fa6-aa90-d965c91c7b44 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:13.330595 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-27b87e22-d269-4fa6-aa90-d965c91c7b44 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:13.331036 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-27b87e22-d269-4fa6-aa90-d965c91c7b44 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:13.331815 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-27b87e22-d269-4fa6-aa90-d965c91c7b44 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:13.332228 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-27b87e22-d269-4fa6-aa90-d965c91c7b44 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:13.426799 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-27b87e22-d269-4fa6-aa90-d965c91c7b44 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 26710 microversion: 2.1 time: 0.107851 Nov 19 03:28:13.427421 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 515/1095] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:13 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 26710 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:13.848267 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-1dbade46-5292-4715-8758-b0123fcf1d3b req-564e7bb0-bec3-447e-a69e-f051fab4c063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a889deb-2a02-4c52-8e3d-a666e5cbb1ba", "name": "network-vif-plugged", "status": "completed", "tag": "7ed0f6c9-ba15-4c53-b55d-b5d4da5d47f5"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:13.849806 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:28:13.849806 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:28:13.857414 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-1dbade46-5292-4715-8758-b0123fcf1d3b req-564e7bb0-bec3-447e-a69e-f051fab4c063 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:13.858099 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-1dbade46-5292-4715-8758-b0123fcf1d3b req-564e7bb0-bec3-447e-a69e-f051fab4c063 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:13.869638 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-1dbade46-5292-4715-8758-b0123fcf1d3b req-564e7bb0-bec3-447e-a69e-f051fab4c063 service nova] Creating event network-vif-plugged:7ed0f6c9-ba15-4c53-b55d-b5d4da5d47f5 for instance 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba on hv-cinder-81803 Nov 19 03:28:13.874529 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-1dbade46-5292-4715-8758-b0123fcf1d3b req-564e7bb0-bec3-447e-a69e-f051fab4c063 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029813 Nov 19 03:28:13.875099 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 581/1096] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:28:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:28:14.024276 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6ff10c2f-f313-4b0e-8725-9038062c4606 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:14.024976 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6ff10c2f-f313-4b0e-8725-9038062c4606 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:14.031775 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ff10c2f-f313-4b0e-8725-9038062c4606 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:14.032212 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ff10c2f-f313-4b0e-8725-9038062c4606 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:14.032971 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ff10c2f-f313-4b0e-8725-9038062c4606 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:14.033399 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ff10c2f-f313-4b0e-8725-9038062c4606 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:14.166586 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-6ff10c2f-f313-4b0e-8725-9038062c4606 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:14.174313 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-6ff10c2f-f313-4b0e-8725-9038062c4606 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:14.175831 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-6ff10c2f-f313-4b0e-8725-9038062c4606 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:14.176982 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6ff10c2f-f313-4b0e-8725-9038062c4606 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1744 microversion: 2.20 time: 0.156714 Nov 19 03:28:14.177756 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 516/1097] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:14 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:14.439295 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d0eb93c6-cd85-455a-8c6f-10345eecfdc3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:14.440296 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d0eb93c6-cd85-455a-8c6f-10345eecfdc3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:14.447468 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d0eb93c6-cd85-455a-8c6f-10345eecfdc3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:14.447922 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d0eb93c6-cd85-455a-8c6f-10345eecfdc3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:14.449161 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d0eb93c6-cd85-455a-8c6f-10345eecfdc3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:14.449161 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d0eb93c6-cd85-455a-8c6f-10345eecfdc3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:14.554180 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d0eb93c6-cd85-455a-8c6f-10345eecfdc3 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 27644 microversion: 2.1 time: 0.118612 Nov 19 03:28:14.555092 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 582/1098] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:14 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 27644 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:28:15.196760 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8e2854ec-90ee-4e71-9276-e6c12d2c3063 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:15.197531 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8e2854ec-90ee-4e71-9276-e6c12d2c3063 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:15.204307 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e2854ec-90ee-4e71-9276-e6c12d2c3063 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:15.204751 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e2854ec-90ee-4e71-9276-e6c12d2c3063 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:15.205519 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e2854ec-90ee-4e71-9276-e6c12d2c3063 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:15.205945 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e2854ec-90ee-4e71-9276-e6c12d2c3063 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:15.344401 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8e2854ec-90ee-4e71-9276-e6c12d2c3063 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:15.352620 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8e2854ec-90ee-4e71-9276-e6c12d2c3063 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:15.355271 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8e2854ec-90ee-4e71-9276-e6c12d2c3063 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:15.355844 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8e2854ec-90ee-4e71-9276-e6c12d2c3063 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1739 microversion: 2.20 time: 0.163254 Nov 19 03:28:15.356420 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 517/1099] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:15 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:15.565882 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a6e48317-d4cc-44d0-bcd3-4f6e3d4d40be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:15.566915 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a6e48317-d4cc-44d0-bcd3-4f6e3d4d40be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:15.574621 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a6e48317-d4cc-44d0-bcd3-4f6e3d4d40be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:15.575061 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a6e48317-d4cc-44d0-bcd3-4f6e3d4d40be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:15.581900 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a6e48317-d4cc-44d0-bcd3-4f6e3d4d40be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:15.582360 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a6e48317-d4cc-44d0-bcd3-4f6e3d4d40be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:15.690693 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a6e48317-d4cc-44d0-bcd3-4f6e3d4d40be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 27926 microversion: 2.1 time: 0.128684 Nov 19 03:28:15.692632 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 583/1100] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:15 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 27926 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:16.374221 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9f66df3d-711f-4b95-a811-9030d7aaac2b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:16.374893 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9f66df3d-711f-4b95-a811-9030d7aaac2b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:16.381758 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9f66df3d-711f-4b95-a811-9030d7aaac2b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:16.382196 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9f66df3d-711f-4b95-a811-9030d7aaac2b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:16.383005 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9f66df3d-711f-4b95-a811-9030d7aaac2b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:16.383453 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9f66df3d-711f-4b95-a811-9030d7aaac2b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:16.523458 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-9f66df3d-711f-4b95-a811-9030d7aaac2b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:16.532332 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-9f66df3d-711f-4b95-a811-9030d7aaac2b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:16.533808 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-9f66df3d-711f-4b95-a811-9030d7aaac2b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:16.535003 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9f66df3d-711f-4b95-a811-9030d7aaac2b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1739 microversion: 2.20 time: 0.164498 Nov 19 03:28:16.541035 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 518/1101] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:16 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:16.704128 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-242a9fe8-1e58-4e98-be97-7c29b8ca8621 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:16.706185 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-242a9fe8-1e58-4e98-be97-7c29b8ca8621 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:16.713758 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-242a9fe8-1e58-4e98-be97-7c29b8ca8621 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:16.714239 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-242a9fe8-1e58-4e98-be97-7c29b8ca8621 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:16.715062 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-242a9fe8-1e58-4e98-be97-7c29b8ca8621 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:16.715678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-242a9fe8-1e58-4e98-be97-7c29b8ca8621 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:16.828678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-242a9fe8-1e58-4e98-be97-7c29b8ca8621 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28192 microversion: 2.1 time: 0.128574 Nov 19 03:28:16.830026 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 584/1102] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:16 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28192 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:17.552866 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-dfaae0eb-9821-45f7-a347-a355ad13ee50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:17.553450 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-dfaae0eb-9821-45f7-a347-a355ad13ee50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:17.560295 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dfaae0eb-9821-45f7-a347-a355ad13ee50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:17.561040 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dfaae0eb-9821-45f7-a347-a355ad13ee50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:17.561829 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dfaae0eb-9821-45f7-a347-a355ad13ee50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:17.562261 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dfaae0eb-9821-45f7-a347-a355ad13ee50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:17.710402 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-dfaae0eb-9821-45f7-a347-a355ad13ee50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:17.736296 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-dfaae0eb-9821-45f7-a347-a355ad13ee50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:17.737779 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-dfaae0eb-9821-45f7-a347-a355ad13ee50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:17.738984 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-dfaae0eb-9821-45f7-a347-a355ad13ee50 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1739 microversion: 2.20 time: 0.189805 Nov 19 03:28:17.742527 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 519/1103] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:17 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:17.843151 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1ebee61d-d34b-43ac-82be-47bda7cd3b45 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:17.844192 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1ebee61d-d34b-43ac-82be-47bda7cd3b45 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:17.851807 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1ebee61d-d34b-43ac-82be-47bda7cd3b45 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:17.852632 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1ebee61d-d34b-43ac-82be-47bda7cd3b45 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:17.854013 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1ebee61d-d34b-43ac-82be-47bda7cd3b45 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:17.854561 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1ebee61d-d34b-43ac-82be-47bda7cd3b45 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:17.948860 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1ebee61d-d34b-43ac-82be-47bda7cd3b45 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28192 microversion: 2.1 time: 0.110257 Nov 19 03:28:17.952079 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 585/1104] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:17 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28192 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:18.257560 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:28:18.258094 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: Fri Nov 19 03:28:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:28:18.756877 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d02eaec5-866a-4a47-8f42-03aac9a0284b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:18.758506 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d02eaec5-866a-4a47-8f42-03aac9a0284b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:18.769157 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d02eaec5-866a-4a47-8f42-03aac9a0284b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:18.769704 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d02eaec5-866a-4a47-8f42-03aac9a0284b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:18.770500 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d02eaec5-866a-4a47-8f42-03aac9a0284b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:18.770943 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d02eaec5-866a-4a47-8f42-03aac9a0284b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:18.924242 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d02eaec5-866a-4a47-8f42-03aac9a0284b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:18.933090 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d02eaec5-866a-4a47-8f42-03aac9a0284b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:18.937838 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d02eaec5-866a-4a47-8f42-03aac9a0284b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:18.939139 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d02eaec5-866a-4a47-8f42-03aac9a0284b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1739 microversion: 2.20 time: 0.185917 Nov 19 03:28:18.939963 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 520/1105] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:18 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:18.962965 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-98490cfb-6f46-47c9-8e2f-099b71ac57f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:18.964201 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-98490cfb-6f46-47c9-8e2f-099b71ac57f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:18.973793 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-98490cfb-6f46-47c9-8e2f-099b71ac57f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:18.974248 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-98490cfb-6f46-47c9-8e2f-099b71ac57f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:18.975069 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-98490cfb-6f46-47c9-8e2f-099b71ac57f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:18.975505 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-98490cfb-6f46-47c9-8e2f-099b71ac57f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:19.077201 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-98490cfb-6f46-47c9-8e2f-099b71ac57f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28192 microversion: 2.1 time: 0.118861 Nov 19 03:28:19.078722 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 586/1106] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:18 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28192 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:19.956814 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c9d043e6-d6fd-453f-a2e7-5a0d15c52649 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:19.957504 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c9d043e6-d6fd-453f-a2e7-5a0d15c52649 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:19.965537 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c9d043e6-d6fd-453f-a2e7-5a0d15c52649 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:19.966102 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c9d043e6-d6fd-453f-a2e7-5a0d15c52649 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:19.966999 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c9d043e6-d6fd-453f-a2e7-5a0d15c52649 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:19.967514 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c9d043e6-d6fd-453f-a2e7-5a0d15c52649 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:20.090954 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-49846473-0674-4fe0-a8ea-3b41d9b8ebb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:20.092985 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-49846473-0674-4fe0-a8ea-3b41d9b8ebb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:20.100636 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-49846473-0674-4fe0-a8ea-3b41d9b8ebb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:20.101187 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-49846473-0674-4fe0-a8ea-3b41d9b8ebb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:20.102142 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-49846473-0674-4fe0-a8ea-3b41d9b8ebb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:20.103381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-49846473-0674-4fe0-a8ea-3b41d9b8ebb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:20.117576 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c9d043e6-d6fd-453f-a2e7-5a0d15c52649 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:20.127950 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c9d043e6-d6fd-453f-a2e7-5a0d15c52649 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:20.129537 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c9d043e6-d6fd-453f-a2e7-5a0d15c52649 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:20.130834 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c9d043e6-d6fd-453f-a2e7-5a0d15c52649 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1739 microversion: 2.20 time: 0.177679 Nov 19 03:28:20.142336 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 521/1107] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:19 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:20.201682 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-49846473-0674-4fe0-a8ea-3b41d9b8ebb0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28192 microversion: 2.1 time: 0.115777 Nov 19 03:28:20.202333 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 587/1108] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:20 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28192 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:28:21.149488 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ba88896d-ae24-4d8c-8ec1-10bb5569c4eb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:21.156102 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ba88896d-ae24-4d8c-8ec1-10bb5569c4eb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:21.173254 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ba88896d-ae24-4d8c-8ec1-10bb5569c4eb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:21.173705 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ba88896d-ae24-4d8c-8ec1-10bb5569c4eb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:21.174651 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ba88896d-ae24-4d8c-8ec1-10bb5569c4eb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:21.175098 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ba88896d-ae24-4d8c-8ec1-10bb5569c4eb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:21.214604 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a380aab0-e3c2-4a1f-b6c2-c1a59b9b6e1a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:21.216798 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a380aab0-e3c2-4a1f-b6c2-c1a59b9b6e1a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:21.223965 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a380aab0-e3c2-4a1f-b6c2-c1a59b9b6e1a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:21.224735 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a380aab0-e3c2-4a1f-b6c2-c1a59b9b6e1a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:21.225947 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a380aab0-e3c2-4a1f-b6c2-c1a59b9b6e1a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:21.226452 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a380aab0-e3c2-4a1f-b6c2-c1a59b9b6e1a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:21.325380 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a380aab0-e3c2-4a1f-b6c2-c1a59b9b6e1a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28192 microversion: 2.1 time: 0.115170 Nov 19 03:28:21.326877 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 588/1109] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:21 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28192 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:21.362851 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ba88896d-ae24-4d8c-8ec1-10bb5569c4eb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:21.377394 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ba88896d-ae24-4d8c-8ec1-10bb5569c4eb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:21.378907 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ba88896d-ae24-4d8c-8ec1-10bb5569c4eb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:21.380074 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ba88896d-ae24-4d8c-8ec1-10bb5569c4eb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1739 microversion: 2.20 time: 0.234483 Nov 19 03:28:21.380629 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 522/1110] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:21 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:22.338240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-fdc2012d-5f40-4e47-8024-e69690f059c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:22.341510 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-fdc2012d-5f40-4e47-8024-e69690f059c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:22.350050 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fdc2012d-5f40-4e47-8024-e69690f059c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:22.350787 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fdc2012d-5f40-4e47-8024-e69690f059c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:22.351617 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fdc2012d-5f40-4e47-8024-e69690f059c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:22.352059 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fdc2012d-5f40-4e47-8024-e69690f059c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:22.399913 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0de5b70a-e0b0-43c2-b2e4-9fc6574bec22 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:22.402189 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0de5b70a-e0b0-43c2-b2e4-9fc6574bec22 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:22.409119 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0de5b70a-e0b0-43c2-b2e4-9fc6574bec22 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:22.409685 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0de5b70a-e0b0-43c2-b2e4-9fc6574bec22 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:22.410581 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0de5b70a-e0b0-43c2-b2e4-9fc6574bec22 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:22.411120 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0de5b70a-e0b0-43c2-b2e4-9fc6574bec22 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:22.447024 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-fdc2012d-5f40-4e47-8024-e69690f059c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28192 microversion: 2.1 time: 0.112664 Nov 19 03:28:22.447890 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 589/1111] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:22 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28192 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:28:22.582883 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0de5b70a-e0b0-43c2-b2e4-9fc6574bec22 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:22.592006 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0de5b70a-e0b0-43c2-b2e4-9fc6574bec22 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:22.593456 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0de5b70a-e0b0-43c2-b2e4-9fc6574bec22 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:22.594663 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0de5b70a-e0b0-43c2-b2e4-9fc6574bec22 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1739 microversion: 2.20 time: 0.198799 Nov 19 03:28:22.596820 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 523/1112] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:22 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:23.458413 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e4897db2-fab6-42ea-839c-0e601484671a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:23.459578 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e4897db2-fab6-42ea-839c-0e601484671a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:23.467366 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e4897db2-fab6-42ea-839c-0e601484671a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:23.467819 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e4897db2-fab6-42ea-839c-0e601484671a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:23.468623 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e4897db2-fab6-42ea-839c-0e601484671a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:23.469063 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e4897db2-fab6-42ea-839c-0e601484671a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:23.555558 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e4897db2-fab6-42ea-839c-0e601484671a tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28192 microversion: 2.1 time: 0.100926 Nov 19 03:28:23.560201 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 590/1113] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:23 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:23.613056 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5861fd1b-df76-4406-b122-e933d53cc193 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:23.613634 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5861fd1b-df76-4406-b122-e933d53cc193 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:23.620905 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5861fd1b-df76-4406-b122-e933d53cc193 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:23.621354 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5861fd1b-df76-4406-b122-e933d53cc193 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:23.622138 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5861fd1b-df76-4406-b122-e933d53cc193 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:23.622597 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5861fd1b-df76-4406-b122-e933d53cc193 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:23.757603 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5861fd1b-df76-4406-b122-e933d53cc193 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:23.766285 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5861fd1b-df76-4406-b122-e933d53cc193 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:23.767971 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5861fd1b-df76-4406-b122-e933d53cc193 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:23.769230 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5861fd1b-df76-4406-b122-e933d53cc193 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1739 microversion: 2.20 time: 0.159970 Nov 19 03:28:23.769770 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 524/1114] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:23 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:24.568214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-77e33a26-d94d-4a40-a2cb-63373460d158 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:24.569233 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-77e33a26-d94d-4a40-a2cb-63373460d158 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:24.576038 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-77e33a26-d94d-4a40-a2cb-63373460d158 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:24.576478 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-77e33a26-d94d-4a40-a2cb-63373460d158 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:24.577246 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-77e33a26-d94d-4a40-a2cb-63373460d158 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:24.577678 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-77e33a26-d94d-4a40-a2cb-63373460d158 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:24.685595 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-77e33a26-d94d-4a40-a2cb-63373460d158 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28192 microversion: 2.1 time: 0.121190 Nov 19 03:28:24.686209 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 591/1115] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:24 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28192 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:24.787467 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ad7a3d79-5e37-4a9c-a895-bed4c02efdeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:24.788332 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ad7a3d79-5e37-4a9c-a895-bed4c02efdeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:24.794623 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ad7a3d79-5e37-4a9c-a895-bed4c02efdeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:24.795074 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ad7a3d79-5e37-4a9c-a895-bed4c02efdeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:24.795854 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ad7a3d79-5e37-4a9c-a895-bed4c02efdeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:24.796289 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ad7a3d79-5e37-4a9c-a895-bed4c02efdeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:24.932539 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ad7a3d79-5e37-4a9c-a895-bed4c02efdeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:24.940793 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ad7a3d79-5e37-4a9c-a895-bed4c02efdeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:24.942263 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ad7a3d79-5e37-4a9c-a895-bed4c02efdeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:24.943442 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ad7a3d79-5e37-4a9c-a895-bed4c02efdeb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1721 microversion: 2.20 time: 0.159695 Nov 19 03:28:24.943998 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 525/1116] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:24 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:25.698135 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8f4090d1-608e-4b13-9951-339017f2957e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:25.699155 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8f4090d1-608e-4b13-9951-339017f2957e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:25.705975 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f4090d1-608e-4b13-9951-339017f2957e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:25.706419 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f4090d1-608e-4b13-9951-339017f2957e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:25.707211 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f4090d1-608e-4b13-9951-339017f2957e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:25.707647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8f4090d1-608e-4b13-9951-339017f2957e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:25.804108 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8f4090d1-608e-4b13-9951-339017f2957e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28192 microversion: 2.1 time: 0.109802 Nov 19 03:28:25.804769 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 592/1117] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:25 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28192 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:25.964492 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-39a397bc-3697-489d-89c3-ef3d0f721118 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:25.965127 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-39a397bc-3697-489d-89c3-ef3d0f721118 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:25.971453 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-39a397bc-3697-489d-89c3-ef3d0f721118 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:25.971903 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-39a397bc-3697-489d-89c3-ef3d0f721118 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:25.972681 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-39a397bc-3697-489d-89c3-ef3d0f721118 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:25.973131 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-39a397bc-3697-489d-89c3-ef3d0f721118 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:26.106777 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-39a397bc-3697-489d-89c3-ef3d0f721118 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:26.114423 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-39a397bc-3697-489d-89c3-ef3d0f721118 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:26.115925 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-39a397bc-3697-489d-89c3-ef3d0f721118 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:26.117071 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-39a397bc-3697-489d-89c3-ef3d0f721118 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1721 microversion: 2.20 time: 0.157537 Nov 19 03:28:26.117638 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 526/1118] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:25 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:26.816273 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2218fa98-b5dd-40fb-a3ea-80692d1459f9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:26.817264 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2218fa98-b5dd-40fb-a3ea-80692d1459f9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:26.824242 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2218fa98-b5dd-40fb-a3ea-80692d1459f9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:26.824688 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2218fa98-b5dd-40fb-a3ea-80692d1459f9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:26.825455 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2218fa98-b5dd-40fb-a3ea-80692d1459f9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:26.825883 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2218fa98-b5dd-40fb-a3ea-80692d1459f9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:26.927794 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2218fa98-b5dd-40fb-a3ea-80692d1459f9 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28192 microversion: 2.1 time: 0.115318 Nov 19 03:28:26.928439 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 593/1119] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:26 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28192 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:27.135465 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-90e5c953-fe9d-478a-9d8c-4f0d5f8f8fe5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:27.136122 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-90e5c953-fe9d-478a-9d8c-4f0d5f8f8fe5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:27.142427 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-90e5c953-fe9d-478a-9d8c-4f0d5f8f8fe5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:27.142910 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-90e5c953-fe9d-478a-9d8c-4f0d5f8f8fe5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:27.143723 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-90e5c953-fe9d-478a-9d8c-4f0d5f8f8fe5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:27.144139 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-90e5c953-fe9d-478a-9d8c-4f0d5f8f8fe5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:27.277759 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-90e5c953-fe9d-478a-9d8c-4f0d5f8f8fe5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:27.285777 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-90e5c953-fe9d-478a-9d8c-4f0d5f8f8fe5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:27.287294 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-90e5c953-fe9d-478a-9d8c-4f0d5f8f8fe5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:27.288714 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-90e5c953-fe9d-478a-9d8c-4f0d5f8f8fe5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1724 microversion: 2.20 time: 0.157524 Nov 19 03:28:27.289272 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 527/1120] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:27 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:27.307544 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7155f836-6140-4f8a-833f-5064d337c135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "897a4d75-0329-4422-83ab-86601e8c77cf"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:27.308679 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7155f836-6140-4f8a-833f-5064d337c135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:27.315716 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7155f836-6140-4f8a-833f-5064d337c135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:27.316161 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7155f836-6140-4f8a-833f-5064d337c135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:27.316938 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7155f836-6140-4f8a-833f-5064d337c135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:27.317373 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7155f836-6140-4f8a-833f-5064d337c135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:27.579875 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7155f836-6140-4f8a-833f-5064d337c135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.277199 Nov 19 03:28:27.580484 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 594/1121] 10.222.0.47 () {62 vars in 1363 bytes} [Fri Nov 19 03:28:27 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/os-volume_attachments => generated 188 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:27.686636 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-18eaf460-fe96-45aa-b9d6-ebb4c0710e42 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:27.687127 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-18eaf460-fe96-45aa-b9d6-ebb4c0710e42 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:27.692912 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-18eaf460-fe96-45aa-b9d6-ebb4c0710e42 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:27.693353 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-18eaf460-fe96-45aa-b9d6-ebb4c0710e42 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:27.694121 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-18eaf460-fe96-45aa-b9d6-ebb4c0710e42 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:27.694584 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-18eaf460-fe96-45aa-b9d6-ebb4c0710e42 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:27.862722 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-a78e7939-0070-4eb7-a916-604881ca01a1 req-c0ab0940-c1f9-4e1f-a03b-e3da40872d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a889deb-2a02-4c52-8e3d-a666e5cbb1ba", "name": "network-vif-unplugged", "status": "completed", "tag": "7ed0f6c9-ba15-4c53-b55d-b5d4da5d47f5"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:27.864994 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:28:27.864994 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:28:27.873515 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-a78e7939-0070-4eb7-a916-604881ca01a1 req-c0ab0940-c1f9-4e1f-a03b-e3da40872d01 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:27.873967 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-a78e7939-0070-4eb7-a916-604881ca01a1 req-c0ab0940-c1f9-4e1f-a03b-e3da40872d01 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:27.885977 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.compute.server_external_events [req-a78e7939-0070-4eb7-a916-604881ca01a1 req-c0ab0940-c1f9-4e1f-a03b-e3da40872d01 service nova] Unable to find a host for instance 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba. Dropping event network-vif-unplugged {{(pid=116065) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 19 03:28:27.886963 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-a78e7939-0070-4eb7-a916-604881ca01a1 req-c0ab0940-c1f9-4e1f-a03b-e3da40872d01 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028016 Nov 19 03:28:27.887532 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 595/1122] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:28:27 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 19 03:28:27.933478 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-18eaf460-fe96-45aa-b9d6-ebb4c0710e42 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/os-volume_attachments/897a4d75-0329-4422-83ab-86601e8c77cf" status: 202 len: 0 microversion: 2.20 time: 0.250588 Nov 19 03:28:27.934078 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 528/1123] 10.222.0.47 () {60 vars in 1456 bytes} [Fri Nov 19 03:28:27 2021] DELETE /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/os-volume_attachments/897a4d75-0329-4422-83ab-86601e8c77cf => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:28:27.939969 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f3f723f1-eafe-474b-b144-dcb9acac3c4e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:27.940878 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f3f723f1-eafe-474b-b144-dcb9acac3c4e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:27.946857 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3f723f1-eafe-474b-b144-dcb9acac3c4e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:27.947453 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3f723f1-eafe-474b-b144-dcb9acac3c4e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:27.948235 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3f723f1-eafe-474b-b144-dcb9acac3c4e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:27.948659 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3f723f1-eafe-474b-b144-dcb9acac3c4e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:27.988445 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ee05c71f-d5db-4fbd-8cf3-10a1aeacfca2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:27.988996 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ee05c71f-d5db-4fbd-8cf3-10a1aeacfca2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:27.995451 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ee05c71f-d5db-4fbd-8cf3-10a1aeacfca2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:27.995890 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ee05c71f-d5db-4fbd-8cf3-10a1aeacfca2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:27.996650 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ee05c71f-d5db-4fbd-8cf3-10a1aeacfca2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:27.997073 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ee05c71f-d5db-4fbd-8cf3-10a1aeacfca2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:28.030295 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f3f723f1-eafe-474b-b144-dcb9acac3c4e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28192 microversion: 2.1 time: 0.093847 Nov 19 03:28:28.034169 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 596/1124] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:27 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:28:28.077434 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ee05c71f-d5db-4fbd-8cf3-10a1aeacfca2 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action" status: 202 len: 0 microversion: 2.20 time: 0.091545 Nov 19 03:28:28.077434 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 529/1125] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Nov 19 03:28:27 2021] POST /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 19 03:28:28.085404 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-bc114808-7ff1-46a3-b37d-afe97c7b775a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:28.086111 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-bc114808-7ff1-46a3-b37d-afe97c7b775a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:28.094753 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bc114808-7ff1-46a3-b37d-afe97c7b775a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:28.095233 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bc114808-7ff1-46a3-b37d-afe97c7b775a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:28.096184 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bc114808-7ff1-46a3-b37d-afe97c7b775a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:28.096734 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bc114808-7ff1-46a3-b37d-afe97c7b775a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:28.259536 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-bc114808-7ff1-46a3-b37d-afe97c7b775a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:28.267676 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-bc114808-7ff1-46a3-b37d-afe97c7b775a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:28.269161 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-bc114808-7ff1-46a3-b37d-afe97c7b775a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:28.270318 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-bc114808-7ff1-46a3-b37d-afe97c7b775a tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1672 microversion: 2.20 time: 0.188961 Nov 19 03:28:28.271067 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 597/1126] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:28 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1672 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:29.043221 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4f33ef35-d419-436c-9376-941a4850d950 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:29.044187 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4f33ef35-d419-436c-9376-941a4850d950 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:29.050097 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4f33ef35-d419-436c-9376-941a4850d950 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:29.050579 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4f33ef35-d419-436c-9376-941a4850d950 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:29.051516 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4f33ef35-d419-436c-9376-941a4850d950 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:29.051796 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4f33ef35-d419-436c-9376-941a4850d950 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:29.154502 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4f33ef35-d419-436c-9376-941a4850d950 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28483 microversion: 2.1 time: 0.116245 Nov 19 03:28:29.155155 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 530/1127] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:29 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28483 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:29.289571 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-36fb55d3-346c-47c4-8efe-d87d939a7230 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:29.290227 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-36fb55d3-346c-47c4-8efe-d87d939a7230 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:29.296479 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-36fb55d3-346c-47c4-8efe-d87d939a7230 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:29.296852 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-36fb55d3-346c-47c4-8efe-d87d939a7230 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:29.297625 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-36fb55d3-346c-47c4-8efe-d87d939a7230 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:29.298052 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-36fb55d3-346c-47c4-8efe-d87d939a7230 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:29.432112 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-36fb55d3-346c-47c4-8efe-d87d939a7230 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:29.439887 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-36fb55d3-346c-47c4-8efe-d87d939a7230 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:29.441396 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-36fb55d3-346c-47c4-8efe-d87d939a7230 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:29.442570 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-36fb55d3-346c-47c4-8efe-d87d939a7230 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.157377 Nov 19 03:28:29.443125 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 598/1128] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:29 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:30.167045 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-544633a0-c947-4b48-b566-5b4e3e2506a0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:30.168802 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-544633a0-c947-4b48-b566-5b4e3e2506a0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:30.175985 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-544633a0-c947-4b48-b566-5b4e3e2506a0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:30.176662 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-544633a0-c947-4b48-b566-5b4e3e2506a0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:30.177604 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-544633a0-c947-4b48-b566-5b4e3e2506a0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:30.178188 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-544633a0-c947-4b48-b566-5b4e3e2506a0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:30.460905 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2a616de9-bf65-451c-a476-4529731aea7e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:30.461629 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2a616de9-bf65-451c-a476-4529731aea7e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:30.468889 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2a616de9-bf65-451c-a476-4529731aea7e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:30.469427 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2a616de9-bf65-451c-a476-4529731aea7e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:30.470289 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2a616de9-bf65-451c-a476-4529731aea7e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:30.470839 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2a616de9-bf65-451c-a476-4529731aea7e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:30.623978 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2a616de9-bf65-451c-a476-4529731aea7e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:30.633518 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2a616de9-bf65-451c-a476-4529731aea7e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:30.636729 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2a616de9-bf65-451c-a476-4529731aea7e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:30.638270 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2a616de9-bf65-451c-a476-4529731aea7e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.181054 Nov 19 03:28:30.638854 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 599/1129] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:30 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:31.656647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-088a913e-210c-4edb-aa4f-fd5d9486a6cb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:31.657324 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-088a913e-210c-4edb-aa4f-fd5d9486a6cb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:31.663685 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-088a913e-210c-4edb-aa4f-fd5d9486a6cb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:31.664127 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-088a913e-210c-4edb-aa4f-fd5d9486a6cb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:31.664891 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-088a913e-210c-4edb-aa4f-fd5d9486a6cb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:31.665318 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-088a913e-210c-4edb-aa4f-fd5d9486a6cb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:31.810352 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-088a913e-210c-4edb-aa4f-fd5d9486a6cb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:31.818295 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-088a913e-210c-4edb-aa4f-fd5d9486a6cb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:31.819812 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-088a913e-210c-4edb-aa4f-fd5d9486a6cb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:31.820961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-088a913e-210c-4edb-aa4f-fd5d9486a6cb tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.167990 Nov 19 03:28:31.822106 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 600/1130] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:31 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:32.840048 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f108b20a-e6fc-439f-ae2c-3eb7299fef68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:32.840840 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f108b20a-e6fc-439f-ae2c-3eb7299fef68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:32.847200 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f108b20a-e6fc-439f-ae2c-3eb7299fef68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:32.847652 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f108b20a-e6fc-439f-ae2c-3eb7299fef68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:32.848440 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f108b20a-e6fc-439f-ae2c-3eb7299fef68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:32.848877 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f108b20a-e6fc-439f-ae2c-3eb7299fef68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:33.001114 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f108b20a-e6fc-439f-ae2c-3eb7299fef68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:33.008749 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f108b20a-e6fc-439f-ae2c-3eb7299fef68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:33.010502 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f108b20a-e6fc-439f-ae2c-3eb7299fef68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:33.011656 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f108b20a-e6fc-439f-ae2c-3eb7299fef68 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.175837 Nov 19 03:28:33.012209 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 601/1131] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:32 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:34.029226 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-08822466-d617-4b3f-873a-73d13c7e4e12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:34.029878 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-08822466-d617-4b3f-873a-73d13c7e4e12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:34.036186 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-08822466-d617-4b3f-873a-73d13c7e4e12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:34.036633 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-08822466-d617-4b3f-873a-73d13c7e4e12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:34.037406 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-08822466-d617-4b3f-873a-73d13c7e4e12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:34.037870 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-08822466-d617-4b3f-873a-73d13c7e4e12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:34.177997 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-08822466-d617-4b3f-873a-73d13c7e4e12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:34.186585 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-08822466-d617-4b3f-873a-73d13c7e4e12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:34.188062 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-08822466-d617-4b3f-873a-73d13c7e4e12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:34.189214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-08822466-d617-4b3f-873a-73d13c7e4e12 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.163873 Nov 19 03:28:34.190128 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 602/1132] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:34 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:35.207430 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8e29599b-6453-4bc9-ad6c-9a18ce8bd4d5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:35.208166 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8e29599b-6453-4bc9-ad6c-9a18ce8bd4d5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:35.214489 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8e29599b-6453-4bc9-ad6c-9a18ce8bd4d5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:35.214939 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8e29599b-6453-4bc9-ad6c-9a18ce8bd4d5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:35.215703 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8e29599b-6453-4bc9-ad6c-9a18ce8bd4d5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:35.216130 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8e29599b-6453-4bc9-ad6c-9a18ce8bd4d5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:35.609934 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8e29599b-6453-4bc9-ad6c-9a18ce8bd4d5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:35.617897 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8e29599b-6453-4bc9-ad6c-9a18ce8bd4d5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:35.620354 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8e29599b-6453-4bc9-ad6c-9a18ce8bd4d5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:35.621511 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8e29599b-6453-4bc9-ad6c-9a18ce8bd4d5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.417754 Nov 19 03:28:35.622089 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 603/1133] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:35 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:36.640350 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b519b1dd-9ce8-44ae-a2ef-728095672678 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:36.641044 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b519b1dd-9ce8-44ae-a2ef-728095672678 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:36.647569 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b519b1dd-9ce8-44ae-a2ef-728095672678 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:36.648093 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b519b1dd-9ce8-44ae-a2ef-728095672678 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:36.648828 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b519b1dd-9ce8-44ae-a2ef-728095672678 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:36.649262 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b519b1dd-9ce8-44ae-a2ef-728095672678 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:36.792090 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b519b1dd-9ce8-44ae-a2ef-728095672678 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:36.799792 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b519b1dd-9ce8-44ae-a2ef-728095672678 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:36.801301 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b519b1dd-9ce8-44ae-a2ef-728095672678 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:36.802446 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b519b1dd-9ce8-44ae-a2ef-728095672678 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.166142 Nov 19 03:28:36.803025 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 604/1134] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:36 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:37.821202 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-57e9107d-28da-418f-96df-8f9ab4e86675 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:37.821991 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-57e9107d-28da-418f-96df-8f9ab4e86675 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:37.828810 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-57e9107d-28da-418f-96df-8f9ab4e86675 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:37.829406 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-57e9107d-28da-418f-96df-8f9ab4e86675 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:37.830222 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-57e9107d-28da-418f-96df-8f9ab4e86675 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:37.830684 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-57e9107d-28da-418f-96df-8f9ab4e86675 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:37.972720 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-57e9107d-28da-418f-96df-8f9ab4e86675 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:37.980934 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-57e9107d-28da-418f-96df-8f9ab4e86675 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:37.982536 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-57e9107d-28da-418f-96df-8f9ab4e86675 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:37.983714 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-57e9107d-28da-418f-96df-8f9ab4e86675 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.166668 Nov 19 03:28:37.991780 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 605/1135] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:37 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:39.002298 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3acb67f3-42b6-453d-adaa-45c378de7e8f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:39.003070 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3acb67f3-42b6-453d-adaa-45c378de7e8f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:39.009417 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3acb67f3-42b6-453d-adaa-45c378de7e8f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:39.009864 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3acb67f3-42b6-453d-adaa-45c378de7e8f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:39.011164 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3acb67f3-42b6-453d-adaa-45c378de7e8f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:39.011607 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3acb67f3-42b6-453d-adaa-45c378de7e8f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:39.156010 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3acb67f3-42b6-453d-adaa-45c378de7e8f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:39.164887 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3acb67f3-42b6-453d-adaa-45c378de7e8f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:39.166960 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3acb67f3-42b6-453d-adaa-45c378de7e8f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:39.168132 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3acb67f3-42b6-453d-adaa-45c378de7e8f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.169590 Nov 19 03:28:39.168930 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 606/1136] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:38 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:40.188437 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9ac1ae84-1fab-4828-846c-2cf9223ed49f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:40.189164 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9ac1ae84-1fab-4828-846c-2cf9223ed49f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:40.195762 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9ac1ae84-1fab-4828-846c-2cf9223ed49f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:40.196212 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9ac1ae84-1fab-4828-846c-2cf9223ed49f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:40.197007 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9ac1ae84-1fab-4828-846c-2cf9223ed49f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:40.197446 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9ac1ae84-1fab-4828-846c-2cf9223ed49f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:40.329551 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9ac1ae84-1fab-4828-846c-2cf9223ed49f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:40.337120 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9ac1ae84-1fab-4828-846c-2cf9223ed49f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:40.338820 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9ac1ae84-1fab-4828-846c-2cf9223ed49f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:40.339962 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9ac1ae84-1fab-4828-846c-2cf9223ed49f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.156132 Nov 19 03:28:40.340511 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 607/1137] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:40 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:41.357918 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7f1a61c7-1538-4c06-bd30-fed1cdd17135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:41.358600 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7f1a61c7-1538-4c06-bd30-fed1cdd17135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:41.364686 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7f1a61c7-1538-4c06-bd30-fed1cdd17135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:41.365135 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7f1a61c7-1538-4c06-bd30-fed1cdd17135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:41.365908 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7f1a61c7-1538-4c06-bd30-fed1cdd17135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:41.366335 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7f1a61c7-1538-4c06-bd30-fed1cdd17135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:41.507751 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7f1a61c7-1538-4c06-bd30-fed1cdd17135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:41.515985 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7f1a61c7-1538-4c06-bd30-fed1cdd17135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:41.517456 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7f1a61c7-1538-4c06-bd30-fed1cdd17135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:41.518625 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7f1a61c7-1538-4c06-bd30-fed1cdd17135 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.165371 Nov 19 03:28:41.519185 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 608/1138] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:41 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:42.536957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8d73fad5-7825-4154-9ecc-36eb5567ef07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:42.537688 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8d73fad5-7825-4154-9ecc-36eb5567ef07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:42.544152 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8d73fad5-7825-4154-9ecc-36eb5567ef07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:42.544599 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8d73fad5-7825-4154-9ecc-36eb5567ef07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:42.545374 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8d73fad5-7825-4154-9ecc-36eb5567ef07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:42.545811 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8d73fad5-7825-4154-9ecc-36eb5567ef07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:42.674079 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8d73fad5-7825-4154-9ecc-36eb5567ef07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:42.682827 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8d73fad5-7825-4154-9ecc-36eb5567ef07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:42.684304 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8d73fad5-7825-4154-9ecc-36eb5567ef07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:42.685468 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8d73fad5-7825-4154-9ecc-36eb5567ef07 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.152249 Nov 19 03:28:42.686223 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 609/1139] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:42 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:43.703817 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4d411073-2842-489f-b76c-802dc87b1f40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:43.704482 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4d411073-2842-489f-b76c-802dc87b1f40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:43.710862 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d411073-2842-489f-b76c-802dc87b1f40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:43.711311 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d411073-2842-489f-b76c-802dc87b1f40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:43.712086 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d411073-2842-489f-b76c-802dc87b1f40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:43.712517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4d411073-2842-489f-b76c-802dc87b1f40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:43.854393 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4d411073-2842-489f-b76c-802dc87b1f40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:43.863674 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4d411073-2842-489f-b76c-802dc87b1f40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:43.866662 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4d411073-2842-489f-b76c-802dc87b1f40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:43.868875 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4d411073-2842-489f-b76c-802dc87b1f40 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.168453 Nov 19 03:28:43.869928 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 610/1140] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:43 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:44.886670 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7fac4132-676e-4248-9972-a45080ac5a23 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:44.887357 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7fac4132-676e-4248-9972-a45080ac5a23 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:44.893517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7fac4132-676e-4248-9972-a45080ac5a23 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:44.893961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7fac4132-676e-4248-9972-a45080ac5a23 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:44.894751 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7fac4132-676e-4248-9972-a45080ac5a23 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:44.895182 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7fac4132-676e-4248-9972-a45080ac5a23 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:45.029049 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7fac4132-676e-4248-9972-a45080ac5a23 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:45.037454 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7fac4132-676e-4248-9972-a45080ac5a23 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:45.039227 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7fac4132-676e-4248-9972-a45080ac5a23 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:45.040407 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7fac4132-676e-4248-9972-a45080ac5a23 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.157501 Nov 19 03:28:45.040965 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 611/1141] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:44 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 03:28:45.714656 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-544633a0-c947-4b48-b566-5b4e3e2506a0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 15.552475 Nov 19 03:28:45.715326 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 531/1142] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:30 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 15554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:46.059781 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d34d0082-f53b-4a76-a2be-2491e1cde706 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:46.060328 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d34d0082-f53b-4a76-a2be-2491e1cde706 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:46.066607 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d34d0082-f53b-4a76-a2be-2491e1cde706 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:46.067056 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d34d0082-f53b-4a76-a2be-2491e1cde706 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:46.067822 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d34d0082-f53b-4a76-a2be-2491e1cde706 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:46.068251 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d34d0082-f53b-4a76-a2be-2491e1cde706 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:46.196627 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d34d0082-f53b-4a76-a2be-2491e1cde706 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:46.204225 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d34d0082-f53b-4a76-a2be-2491e1cde706 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:46.205698 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d34d0082-f53b-4a76-a2be-2491e1cde706 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:46.206864 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d34d0082-f53b-4a76-a2be-2491e1cde706 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.151422 Nov 19 03:28:46.207429 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 612/1143] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:46 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:46.726638 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-364a2f9d-b19c-4fd2-b9d8-64de964213c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:46.727636 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-364a2f9d-b19c-4fd2-b9d8-64de964213c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:46.735718 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-364a2f9d-b19c-4fd2-b9d8-64de964213c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:46.736168 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-364a2f9d-b19c-4fd2-b9d8-64de964213c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:46.736965 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-364a2f9d-b19c-4fd2-b9d8-64de964213c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:46.737398 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-364a2f9d-b19c-4fd2-b9d8-64de964213c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:46.827262 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-364a2f9d-b19c-4fd2-b9d8-64de964213c8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.104481 Nov 19 03:28:46.827970 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 532/1144] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:46 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:47.224939 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-44e702aa-d276-4510-9e4e-3d853298f762 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:47.225541 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-44e702aa-d276-4510-9e4e-3d853298f762 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:47.232178 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-44e702aa-d276-4510-9e4e-3d853298f762 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:47.232627 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-44e702aa-d276-4510-9e4e-3d853298f762 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:47.233391 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-44e702aa-d276-4510-9e4e-3d853298f762 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:47.233824 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-44e702aa-d276-4510-9e4e-3d853298f762 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:47.385740 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-44e702aa-d276-4510-9e4e-3d853298f762 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:47.414590 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-44e702aa-d276-4510-9e4e-3d853298f762 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:47.416448 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-44e702aa-d276-4510-9e4e-3d853298f762 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:47.417974 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-44e702aa-d276-4510-9e4e-3d853298f762 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.196558 Nov 19 03:28:47.419273 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 613/1145] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:47 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:47.838920 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cdaa89c8-c6a7-485f-814b-66338ce3c7a4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:47.840501 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-cdaa89c8-c6a7-485f-814b-66338ce3c7a4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:47.847588 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cdaa89c8-c6a7-485f-814b-66338ce3c7a4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:47.848049 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cdaa89c8-c6a7-485f-814b-66338ce3c7a4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:47.848825 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cdaa89c8-c6a7-485f-814b-66338ce3c7a4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:47.849260 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-cdaa89c8-c6a7-485f-814b-66338ce3c7a4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:47.935197 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cdaa89c8-c6a7-485f-814b-66338ce3c7a4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.100067 Nov 19 03:28:47.936117 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 533/1146] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:47 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:48.456307 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7a394f09-f545-4e79-9fe2-6810eeb262a1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:48.456891 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7a394f09-f545-4e79-9fe2-6810eeb262a1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:48.463100 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7a394f09-f545-4e79-9fe2-6810eeb262a1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:48.463537 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7a394f09-f545-4e79-9fe2-6810eeb262a1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:48.464295 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7a394f09-f545-4e79-9fe2-6810eeb262a1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:48.464773 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7a394f09-f545-4e79-9fe2-6810eeb262a1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:48.592584 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7a394f09-f545-4e79-9fe2-6810eeb262a1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:48.600261 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7a394f09-f545-4e79-9fe2-6810eeb262a1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:48.601730 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7a394f09-f545-4e79-9fe2-6810eeb262a1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:48.602901 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7a394f09-f545-4e79-9fe2-6810eeb262a1 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.150303 Nov 19 03:28:48.603456 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 614/1147] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:48 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:48.946389 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ed3df99d-265f-4f67-b9f9-c595a259ebd4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:48.947342 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ed3df99d-265f-4f67-b9f9-c595a259ebd4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:48.954104 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed3df99d-265f-4f67-b9f9-c595a259ebd4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:48.954576 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed3df99d-265f-4f67-b9f9-c595a259ebd4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:48.955340 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed3df99d-265f-4f67-b9f9-c595a259ebd4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:48.955766 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ed3df99d-265f-4f67-b9f9-c595a259ebd4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:49.040667 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ed3df99d-265f-4f67-b9f9-c595a259ebd4 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.098179 Nov 19 03:28:49.041332 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 534/1148] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:48 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:49.621917 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f4baf4f0-5def-4a22-8128-63478f4ee2b3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:49.622581 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f4baf4f0-5def-4a22-8128-63478f4ee2b3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:49.628842 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4baf4f0-5def-4a22-8128-63478f4ee2b3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:49.629327 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4baf4f0-5def-4a22-8128-63478f4ee2b3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:49.630102 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4baf4f0-5def-4a22-8128-63478f4ee2b3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:49.630572 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4baf4f0-5def-4a22-8128-63478f4ee2b3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:49.766636 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f4baf4f0-5def-4a22-8128-63478f4ee2b3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:49.774558 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f4baf4f0-5def-4a22-8128-63478f4ee2b3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:49.776381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f4baf4f0-5def-4a22-8128-63478f4ee2b3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:49.777599 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f4baf4f0-5def-4a22-8128-63478f4ee2b3 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.159594 Nov 19 03:28:49.778174 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 615/1149] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:49 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:50.053545 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-dc8c3bcf-6f0a-432d-86b3-49bdb5967cb2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:50.059383 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-dc8c3bcf-6f0a-432d-86b3-49bdb5967cb2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:50.063090 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dc8c3bcf-6f0a-432d-86b3-49bdb5967cb2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:50.063525 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dc8c3bcf-6f0a-432d-86b3-49bdb5967cb2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:50.064318 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dc8c3bcf-6f0a-432d-86b3-49bdb5967cb2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:50.064745 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dc8c3bcf-6f0a-432d-86b3-49bdb5967cb2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:50.158397 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-dc8c3bcf-6f0a-432d-86b3-49bdb5967cb2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.109115 Nov 19 03:28:50.159380 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 535/1150] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:50 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:50.798587 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-594cd7b8-3abe-4228-afc6-ff6343a30409 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:50.799568 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-594cd7b8-3abe-4228-afc6-ff6343a30409 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:50.806771 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-594cd7b8-3abe-4228-afc6-ff6343a30409 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:50.807213 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-594cd7b8-3abe-4228-afc6-ff6343a30409 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:50.807994 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-594cd7b8-3abe-4228-afc6-ff6343a30409 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:50.808454 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-594cd7b8-3abe-4228-afc6-ff6343a30409 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:50.941880 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-594cd7b8-3abe-4228-afc6-ff6343a30409 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:50.950368 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-594cd7b8-3abe-4228-afc6-ff6343a30409 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:50.951871 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-594cd7b8-3abe-4228-afc6-ff6343a30409 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:50.953012 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-594cd7b8-3abe-4228-afc6-ff6343a30409 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.159590 Nov 19 03:28:50.953555 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 616/1151] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:50 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:51.171108 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-dec325b2-0a6d-4486-bd85-03cee3b78da1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:51.172106 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-dec325b2-0a6d-4486-bd85-03cee3b78da1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:51.179671 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dec325b2-0a6d-4486-bd85-03cee3b78da1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:51.180120 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dec325b2-0a6d-4486-bd85-03cee3b78da1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:51.180886 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dec325b2-0a6d-4486-bd85-03cee3b78da1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:51.181317 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dec325b2-0a6d-4486-bd85-03cee3b78da1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:51.272998 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-dec325b2-0a6d-4486-bd85-03cee3b78da1 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.105719 Nov 19 03:28:51.273617 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 536/1152] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:51 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:51.970947 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e40c1ffc-ccdd-49b5-b41b-81677272c603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:51.971561 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e40c1ffc-ccdd-49b5-b41b-81677272c603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:51.977759 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e40c1ffc-ccdd-49b5-b41b-81677272c603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:51.978208 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e40c1ffc-ccdd-49b5-b41b-81677272c603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:51.979008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e40c1ffc-ccdd-49b5-b41b-81677272c603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:51.979444 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e40c1ffc-ccdd-49b5-b41b-81677272c603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:52.043497 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-4fe611b1-6557-49c3-91c2-f50276eb943d req-7b6071c9-eef8-44fe-b38d-fe8fc7be4e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a889deb-2a02-4c52-8e3d-a666e5cbb1ba", "name": "network-vif-plugged", "status": "completed", "tag": "7ed0f6c9-ba15-4c53-b55d-b5d4da5d47f5"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:52.045263 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:28:52.045263 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:28:52.053378 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-4fe611b1-6557-49c3-91c2-f50276eb943d req-7b6071c9-eef8-44fe-b38d-fe8fc7be4e27 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:52.053820 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-4fe611b1-6557-49c3-91c2-f50276eb943d req-7b6071c9-eef8-44fe-b38d-fe8fc7be4e27 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:52.070329 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-4fe611b1-6557-49c3-91c2-f50276eb943d req-7b6071c9-eef8-44fe-b38d-fe8fc7be4e27 service nova] Creating event network-vif-plugged:7ed0f6c9-ba15-4c53-b55d-b5d4da5d47f5 for instance 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba on hv-cinder-81803 Nov 19 03:28:52.076454 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-4fe611b1-6557-49c3-91c2-f50276eb943d req-7b6071c9-eef8-44fe-b38d-fe8fc7be4e27 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037662 Nov 19 03:28:52.077838 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 537/1153] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:28:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:28:52.122121 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e40c1ffc-ccdd-49b5-b41b-81677272c603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:52.131591 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e40c1ffc-ccdd-49b5-b41b-81677272c603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:52.133045 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e40c1ffc-ccdd-49b5-b41b-81677272c603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:52.134242 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e40c1ffc-ccdd-49b5-b41b-81677272c603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.166962 Nov 19 03:28:52.134841 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 617/1154] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:51 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:52.285485 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-38b79929-8389-4de3-a50e-df3ab9cf36b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:52.286595 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-38b79929-8389-4de3-a50e-df3ab9cf36b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:52.294352 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-38b79929-8389-4de3-a50e-df3ab9cf36b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:52.294822 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-38b79929-8389-4de3-a50e-df3ab9cf36b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:52.295670 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-38b79929-8389-4de3-a50e-df3ab9cf36b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:52.296092 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-38b79929-8389-4de3-a50e-df3ab9cf36b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:52.776768 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-38b79929-8389-4de3-a50e-df3ab9cf36b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.495607 Nov 19 03:28:52.778017 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 538/1155] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:52 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:53.152145 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9b6fb5f1-263b-4542-bc73-1d90e7bae72f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:53.152763 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9b6fb5f1-263b-4542-bc73-1d90e7bae72f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:53.159011 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9b6fb5f1-263b-4542-bc73-1d90e7bae72f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:53.159454 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9b6fb5f1-263b-4542-bc73-1d90e7bae72f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:53.160220 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9b6fb5f1-263b-4542-bc73-1d90e7bae72f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:53.160649 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9b6fb5f1-263b-4542-bc73-1d90e7bae72f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:53.290515 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9b6fb5f1-263b-4542-bc73-1d90e7bae72f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:53.298167 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9b6fb5f1-263b-4542-bc73-1d90e7bae72f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:53.299699 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9b6fb5f1-263b-4542-bc73-1d90e7bae72f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:53.300831 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9b6fb5f1-263b-4542-bc73-1d90e7bae72f tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.152395 Nov 19 03:28:53.301384 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 618/1156] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:53 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:53.789911 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-11bdd4b9-0f91-45df-93f9-312fb2d0f520 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:53.790918 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-11bdd4b9-0f91-45df-93f9-312fb2d0f520 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:53.801402 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-11bdd4b9-0f91-45df-93f9-312fb2d0f520 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:53.801840 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-11bdd4b9-0f91-45df-93f9-312fb2d0f520 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:53.802655 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-11bdd4b9-0f91-45df-93f9-312fb2d0f520 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:53.803083 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-11bdd4b9-0f91-45df-93f9-312fb2d0f520 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:53.897327 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-11bdd4b9-0f91-45df-93f9-312fb2d0f520 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.111501 Nov 19 03:28:53.897993 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 539/1157] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:53 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:54.318666 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2ff97838-1aff-4fc2-9c24-f08e586ed7c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:54.319259 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2ff97838-1aff-4fc2-9c24-f08e586ed7c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:54.326173 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2ff97838-1aff-4fc2-9c24-f08e586ed7c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:54.326720 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2ff97838-1aff-4fc2-9c24-f08e586ed7c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:54.327577 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2ff97838-1aff-4fc2-9c24-f08e586ed7c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:54.328101 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2ff97838-1aff-4fc2-9c24-f08e586ed7c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:54.461722 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2ff97838-1aff-4fc2-9c24-f08e586ed7c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:54.470068 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2ff97838-1aff-4fc2-9c24-f08e586ed7c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:54.471558 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2ff97838-1aff-4fc2-9c24-f08e586ed7c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:54.472705 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2ff97838-1aff-4fc2-9c24-f08e586ed7c5 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1730 microversion: 2.20 time: 0.157836 Nov 19 03:28:54.473263 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 619/1158] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:54 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:54.909984 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3831d98d-07d2-4c97-ba9c-0b2d7419ca40 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:54.911154 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3831d98d-07d2-4c97-ba9c-0b2d7419ca40 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:54.919356 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3831d98d-07d2-4c97-ba9c-0b2d7419ca40 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:54.919807 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3831d98d-07d2-4c97-ba9c-0b2d7419ca40 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:54.920592 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3831d98d-07d2-4c97-ba9c-0b2d7419ca40 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:54.921024 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3831d98d-07d2-4c97-ba9c-0b2d7419ca40 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:55.038883 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3831d98d-07d2-4c97-ba9c-0b2d7419ca40 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.132711 Nov 19 03:28:55.040506 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 540/1159] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:54 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:55.490698 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2dec141a-ec78-42e7-8787-77f4afda3394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:28:55.491337 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2dec141a-ec78-42e7-8787-77f4afda3394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:55.497958 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2dec141a-ec78-42e7-8787-77f4afda3394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:55.498404 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2dec141a-ec78-42e7-8787-77f4afda3394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:55.499197 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2dec141a-ec78-42e7-8787-77f4afda3394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:55.499629 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2dec141a-ec78-42e7-8787-77f4afda3394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:55.637710 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2dec141a-ec78-42e7-8787-77f4afda3394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:55.645373 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2dec141a-ec78-42e7-8787-77f4afda3394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:55.647009 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2dec141a-ec78-42e7-8787-77f4afda3394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:28:55.648146 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2dec141a-ec78-42e7-8787-77f4afda3394 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1717 microversion: 2.20 time: 0.161166 Nov 19 03:28:55.648691 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 620/1160] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:28:55 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:28:56.051910 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-999f6dd7-f366-4e44-bae5-641bc4027c37 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:56.052942 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-999f6dd7-f366-4e44-bae5-641bc4027c37 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:56.060643 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-999f6dd7-f366-4e44-bae5-641bc4027c37 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:56.061100 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-999f6dd7-f366-4e44-bae5-641bc4027c37 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:56.061888 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-999f6dd7-f366-4e44-bae5-641bc4027c37 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:56.062351 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-999f6dd7-f366-4e44-bae5-641bc4027c37 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:56.156382 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-999f6dd7-f366-4e44-bae5-641bc4027c37 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.108556 Nov 19 03:28:56.157165 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 541/1161] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:56 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:57.168340 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-cec513c3-9b4c-4d44-acab-ae02e218b677 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:57.169260 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-cec513c3-9b4c-4d44-acab-ae02e218b677 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:57.175676 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cec513c3-9b4c-4d44-acab-ae02e218b677 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:57.176128 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cec513c3-9b4c-4d44-acab-ae02e218b677 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:57.176932 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cec513c3-9b4c-4d44-acab-ae02e218b677 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:57.177368 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cec513c3-9b4c-4d44-acab-ae02e218b677 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:57.259667 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-cec513c3-9b4c-4d44-acab-ae02e218b677 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.095217 Nov 19 03:28:57.260282 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 621/1162] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:57 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:58.271813 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-06ed2333-9739-4d2e-a08f-64ec06074938 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:58.273016 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-06ed2333-9739-4d2e-a08f-64ec06074938 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:58.280327 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-06ed2333-9739-4d2e-a08f-64ec06074938 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:58.280792 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-06ed2333-9739-4d2e-a08f-64ec06074938 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:58.281555 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-06ed2333-9739-4d2e-a08f-64ec06074938 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:58.281980 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-06ed2333-9739-4d2e-a08f-64ec06074938 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:58.362776 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-06ed2333-9739-4d2e-a08f-64ec06074938 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.094841 Nov 19 03:28:58.363391 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 542/1163] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:58 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:28:59.375275 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-31be1c14-deec-4c5c-8123-04f14578e413 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:28:59.376190 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-31be1c14-deec-4c5c-8123-04f14578e413 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:28:59.383050 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-31be1c14-deec-4c5c-8123-04f14578e413 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:59.383481 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-31be1c14-deec-4c5c-8123-04f14578e413 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:59.384250 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-31be1c14-deec-4c5c-8123-04f14578e413 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:28:59.384681 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-31be1c14-deec-4c5c-8123-04f14578e413 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:28:59.469359 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-31be1c14-deec-4c5c-8123-04f14578e413 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.098209 Nov 19 03:28:59.469999 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 622/1164] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:28:59 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:00.482512 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-575ac4e7-3fdb-4c38-b16e-4db88c2b03dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:00.486373 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-575ac4e7-3fdb-4c38-b16e-4db88c2b03dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:00.490719 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-575ac4e7-3fdb-4c38-b16e-4db88c2b03dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:00.491167 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-575ac4e7-3fdb-4c38-b16e-4db88c2b03dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:00.491955 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-575ac4e7-3fdb-4c38-b16e-4db88c2b03dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:00.492387 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-575ac4e7-3fdb-4c38-b16e-4db88c2b03dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:00.574486 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-575ac4e7-3fdb-4c38-b16e-4db88c2b03dd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.096627 Nov 19 03:29:00.575377 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 543/1165] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:00 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:01.586376 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-cc622549-f39f-4589-a329-4359e96be40f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:01.587412 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-cc622549-f39f-4589-a329-4359e96be40f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:01.594991 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc622549-f39f-4589-a329-4359e96be40f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:01.595443 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc622549-f39f-4589-a329-4359e96be40f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:01.596216 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc622549-f39f-4589-a329-4359e96be40f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:01.596648 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-cc622549-f39f-4589-a329-4359e96be40f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:01.682816 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-cc622549-f39f-4589-a329-4359e96be40f tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 28651 microversion: 2.1 time: 0.100234 Nov 19 03:29:01.683443 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 623/1166] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:01 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 28651 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:01.913348 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-90a353c6-7914-4b20-821b-1d6ac6eefcb5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:01.913893 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-90a353c6-7914-4b20-821b-1d6ac6eefcb5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:01.923450 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-90a353c6-7914-4b20-821b-1d6ac6eefcb5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:01.923931 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-90a353c6-7914-4b20-821b-1d6ac6eefcb5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:01.924699 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-90a353c6-7914-4b20-821b-1d6ac6eefcb5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:01.925127 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-90a353c6-7914-4b20-821b-1d6ac6eefcb5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:01.952322 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-90a353c6-7914-4b20-821b-1d6ac6eefcb5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Going to try to terminate instance {{(pid=116066) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:29:02.028411 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-90a353c6-7914-4b20-821b-1d6ac6eefcb5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 204 len: 0 microversion: 2.1 time: 0.118829 Nov 19 03:29:02.028996 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 544/1167] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:29:01 2021] DELETE /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:29:02.037353 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-562e5f75-f01e-4d3f-8be8-6d1367a9b9f6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:02.038137 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-562e5f75-f01e-4d3f-8be8-6d1367a9b9f6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:02.045958 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-562e5f75-f01e-4d3f-8be8-6d1367a9b9f6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:02.046404 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-562e5f75-f01e-4d3f-8be8-6d1367a9b9f6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:02.047208 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-562e5f75-f01e-4d3f-8be8-6d1367a9b9f6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:02.047645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-562e5f75-f01e-4d3f-8be8-6d1367a9b9f6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:02.181905 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-562e5f75-f01e-4d3f-8be8-6d1367a9b9f6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:02.190885 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-562e5f75-f01e-4d3f-8be8-6d1367a9b9f6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1577 microversion: 2.1 time: 0.157484 Nov 19 03:29:02.191450 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 624/1168] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:02 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:02.695708 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6effd208-5def-4646-b176-98085a0442b2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:02.696675 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6effd208-5def-4646-b176-98085a0442b2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:02.702972 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6effd208-5def-4646-b176-98085a0442b2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:02.703416 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6effd208-5def-4646-b176-98085a0442b2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:02.704174 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6effd208-5def-4646-b176-98085a0442b2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:02.704596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6effd208-5def-4646-b176-98085a0442b2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:02.805232 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6effd208-5def-4646-b176-98085a0442b2 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 29575 microversion: 2.1 time: 0.113451 Nov 19 03:29:02.805891 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 545/1169] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:02 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 29575 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:03.208885 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ad2ca073-65a0-476f-8800-9bba079c836d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:03.209492 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ad2ca073-65a0-476f-8800-9bba079c836d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:03.216445 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ad2ca073-65a0-476f-8800-9bba079c836d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:03.216925 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ad2ca073-65a0-476f-8800-9bba079c836d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:03.217769 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ad2ca073-65a0-476f-8800-9bba079c836d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:03.218264 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ad2ca073-65a0-476f-8800-9bba079c836d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:03.351464 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ad2ca073-65a0-476f-8800-9bba079c836d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:03.358761 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ad2ca073-65a0-476f-8800-9bba079c836d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1577 microversion: 2.1 time: 0.153549 Nov 19 03:29:03.359325 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 625/1170] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:03 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:03.817871 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c4463c3b-1339-47fe-80f4-a812d2a05b02 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:03.819023 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c4463c3b-1339-47fe-80f4-a812d2a05b02 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:03.825669 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c4463c3b-1339-47fe-80f4-a812d2a05b02 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:03.826217 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c4463c3b-1339-47fe-80f4-a812d2a05b02 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:03.827521 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c4463c3b-1339-47fe-80f4-a812d2a05b02 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:03.827949 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c4463c3b-1339-47fe-80f4-a812d2a05b02 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:03.935423 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c4463c3b-1339-47fe-80f4-a812d2a05b02 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 31289 microversion: 2.1 time: 0.121354 Nov 19 03:29:03.936666 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 546/1171] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:03 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 31289 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:04.375420 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2c372a65-4bed-4c9a-a075-af88b52f63ae tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:04.376035 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2c372a65-4bed-4c9a-a075-af88b52f63ae tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:04.382177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c372a65-4bed-4c9a-a075-af88b52f63ae tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:04.382662 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c372a65-4bed-4c9a-a075-af88b52f63ae tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:04.383446 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c372a65-4bed-4c9a-a075-af88b52f63ae tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:04.383878 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2c372a65-4bed-4c9a-a075-af88b52f63ae tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:04.516986 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2c372a65-4bed-4c9a-a075-af88b52f63ae tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:04.524452 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2c372a65-4bed-4c9a-a075-af88b52f63ae tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1577 microversion: 2.1 time: 0.152767 Nov 19 03:29:04.525024 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 626/1172] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:04 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:04.950346 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a59a85ae-3fb8-46f1-abfa-abdd737e89f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:04.951497 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a59a85ae-3fb8-46f1-abfa-abdd737e89f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:04.958628 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a59a85ae-3fb8-46f1-abfa-abdd737e89f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:04.959148 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a59a85ae-3fb8-46f1-abfa-abdd737e89f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:04.960054 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a59a85ae-3fb8-46f1-abfa-abdd737e89f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:04.960541 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a59a85ae-3fb8-46f1-abfa-abdd737e89f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:04.996004 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-0074d242-e500-498a-8401-f6948f310e4a req-d14f2f02-daa8-4187-a674-fd5217af2a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d415530f-d634-4a3a-bf17-d3574e19d21f", "name": "network-vif-deleted", "tag": "f37e9732-3229-47e7-8d66-8002cfe7275d"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:04.997582 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:29:04.997582 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:29:05.005892 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-0074d242-e500-498a-8401-f6948f310e4a req-d14f2f02-daa8-4187-a674-fd5217af2a06 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:05.006342 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-0074d242-e500-498a-8401-f6948f310e4a req-d14f2f02-daa8-4187-a674-fd5217af2a06 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:05.018128 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-0074d242-e500-498a-8401-f6948f310e4a req-d14f2f02-daa8-4187-a674-fd5217af2a06 service nova] Creating event network-vif-deleted:f37e9732-3229-47e7-8d66-8002cfe7275d for instance d415530f-d634-4a3a-bf17-d3574e19d21f on hv-cinder-81803 Nov 19 03:29:05.023295 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-0074d242-e500-498a-8401-f6948f310e4a req-d14f2f02-daa8-4187-a674-fd5217af2a06 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030951 Nov 19 03:29:05.024459 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 627/1173] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:29:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:29:05.102937 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a59a85ae-3fb8-46f1-abfa-abdd737e89f0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 33058 microversion: 2.1 time: 0.156469 Nov 19 03:29:05.109019 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 547/1174] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:04 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 33058 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:05.542559 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0a31b59d-888a-421f-97fa-0b80fb9d1b9d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:05.544549 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0a31b59d-888a-421f-97fa-0b80fb9d1b9d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:05.551006 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a31b59d-888a-421f-97fa-0b80fb9d1b9d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:05.551533 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a31b59d-888a-421f-97fa-0b80fb9d1b9d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:05.552317 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a31b59d-888a-421f-97fa-0b80fb9d1b9d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:05.552742 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a31b59d-888a-421f-97fa-0b80fb9d1b9d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:05.588814 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a31b59d-888a-421f-97fa-0b80fb9d1b9d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:05.589256 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0a31b59d-888a-421f-97fa-0b80fb9d1b9d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:05.589815 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-0a31b59d-888a-421f-97fa-0b80fb9d1b9d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lazy-loading 'fault' on Instance uuid d415530f-d634-4a3a-bf17-d3574e19d21f {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:29:05.639319 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0a31b59d-888a-421f-97fa-0b80fb9d1b9d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:05.646945 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0a31b59d-888a-421f-97fa-0b80fb9d1b9d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 200 len: 1230 microversion: 2.1 time: 0.108714 Nov 19 03:29:05.647697 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 628/1175] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:05 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:06.116669 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8ec2cca7-8701-4314-bd17-00380d49904b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:06.117670 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8ec2cca7-8701-4314-bd17-00380d49904b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:06.125412 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8ec2cca7-8701-4314-bd17-00380d49904b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:06.126099 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8ec2cca7-8701-4314-bd17-00380d49904b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:06.127089 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8ec2cca7-8701-4314-bd17-00380d49904b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:06.127720 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8ec2cca7-8701-4314-bd17-00380d49904b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:06.238528 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8ec2cca7-8701-4314-bd17-00380d49904b tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 33791 microversion: 2.1 time: 0.125611 Nov 19 03:29:06.239443 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 548/1176] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:06 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 33791 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:06.664957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-88a225f0-cac3-4a8a-a827-282c2ff557b6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:06.665479 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-88a225f0-cac3-4a8a-a827-282c2ff557b6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:06.671942 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-88a225f0-cac3-4a8a-a827-282c2ff557b6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:06.672394 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-88a225f0-cac3-4a8a-a827-282c2ff557b6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:06.673178 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-88a225f0-cac3-4a8a-a827-282c2ff557b6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:06.673656 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-88a225f0-cac3-4a8a-a827-282c2ff557b6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:06.687060 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-88a225f0-cac3-4a8a-a827-282c2ff557b6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] HTTP exception thrown: Instance d415530f-d634-4a3a-bf17-d3574e19d21f could not be found. Nov 19 03:29:06.687632 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-88a225f0-cac3-4a8a-a827-282c2ff557b6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Returning 404 to user: Instance d415530f-d634-4a3a-bf17-d3574e19d21f could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:29:06.688443 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-88a225f0-cac3-4a8a-a827-282c2ff557b6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 404 len: 111 microversion: 2.1 time: 0.027618 Nov 19 03:29:06.688961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 629/1177] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:06 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:29:06.783203 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1941294522", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-884116023", "security_groups": [{"name": "tempest-secgroup-smoke-1741082130"}], "block_device_mapping_v2": [{"uuid": "ed0d97ad-80a0-428e-94d7-ee8a010b8ffd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ec6214ac-d99f-413c-a1b4-78005c417695"}]}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:06.890365 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.network.neutron [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] validate_networks() for [('ec6214ac-d99f-413c-a1b4-78005c417695', None, None, None, None, None)] {{(pid=116066) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:29:07.250670 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f2500af1-ac7d-4a27-9ae4-69a6fae3c9b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:07.251688 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f2500af1-ac7d-4a27-9ae4-69a6fae3c9b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:07.253168 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Flavor limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:29:07.253666 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Image limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:29:07.254037 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Flavor pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:29:07.254437 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Image pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:29:07.254877 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:29:07.257570 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f2500af1-ac7d-4a27-9ae4-69a6fae3c9b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:07.258030 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f2500af1-ac7d-4a27-9ae4-69a6fae3c9b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:07.258875 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f2500af1-ac7d-4a27-9ae4-69a6fae3c9b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:07.259494 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f2500af1-ac7d-4a27-9ae4-69a6fae3c9b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:07.263347 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:07.264506 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:07.265225 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:07.265651 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:07.282740 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Getting quotas for project 0b123731cbb4468b8bae663587e792e7. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:29:07.286763 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Getting quotas for user 46cac61c2b3543fb8be6fbab87677bb2 and project 0b123731cbb4468b8bae663587e792e7. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:29:07.341532 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Going to run 1 instances... {{(pid=116066) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:29:07.343798 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed0d97ad-80a0-428e-94d7-ee8a010b8ffd',volume_size=None,volume_type=None)] {{(pid=116066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:29:07.362299 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f2500af1-ac7d-4a27-9ae4-69a6fae3c9b8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 34983 microversion: 2.1 time: 0.116042 Nov 19 03:29:07.363662 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 630/1178] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:07 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 34983 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 03:29:07.467894 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7bb3b7de-c734-4679-a108-f3ced80672c6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.688618 Nov 19 03:29:07.468544 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 549/1179] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:29:06 2021] POST /compute/v2.1/servers => generated 406 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:29:07.479561 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7f86b570-f93a-485e-8a19-486b400eab16 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:07.480258 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7f86b570-f93a-485e-8a19-486b400eab16 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:07.542275 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7f86b570-f93a-485e-8a19-486b400eab16 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:07.549373 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7f86b570-f93a-485e-8a19-486b400eab16 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1094 microversion: 2.1 time: 0.074363 Nov 19 03:29:07.550156 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 631/1180] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:07 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:29:08.374725 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-04df10aa-b276-40b4-8a86-acfbeea530d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:08.375865 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-04df10aa-b276-40b4-8a86-acfbeea530d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:08.382074 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04df10aa-b276-40b4-8a86-acfbeea530d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:08.382552 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04df10aa-b276-40b4-8a86-acfbeea530d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:08.383329 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04df10aa-b276-40b4-8a86-acfbeea530d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:08.383760 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-04df10aa-b276-40b4-8a86-acfbeea530d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:08.519638 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-04df10aa-b276-40b4-8a86-acfbeea530d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 35971 microversion: 2.1 time: 0.149228 Nov 19 03:29:08.520263 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 550/1181] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:08 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 35971 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:08.567702 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2ea4013c-e050-4e2e-825e-e7187b4a1d22 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:08.568356 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2ea4013c-e050-4e2e-825e-e7187b4a1d22 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:08.575560 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2ea4013c-e050-4e2e-825e-e7187b4a1d22 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:08.576778 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2ea4013c-e050-4e2e-825e-e7187b4a1d22 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:08.577961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2ea4013c-e050-4e2e-825e-e7187b4a1d22 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:08.578401 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2ea4013c-e050-4e2e-825e-e7187b4a1d22 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:08.646187 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2ea4013c-e050-4e2e-825e-e7187b4a1d22 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:08.655871 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2ea4013c-e050-4e2e-825e-e7187b4a1d22 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1200 microversion: 2.1 time: 0.091758 Nov 19 03:29:08.656737 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 632/1182] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:08 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1200 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:29:09.533191 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8af953f1-b301-4704-bc5d-271640bbe54d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:09.534233 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8af953f1-b301-4704-bc5d-271640bbe54d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:09.541742 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8af953f1-b301-4704-bc5d-271640bbe54d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:09.542190 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8af953f1-b301-4704-bc5d-271640bbe54d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:09.543023 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8af953f1-b301-4704-bc5d-271640bbe54d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:09.543453 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8af953f1-b301-4704-bc5d-271640bbe54d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:09.647367 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8af953f1-b301-4704-bc5d-271640bbe54d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 37425 microversion: 2.1 time: 0.119337 Nov 19 03:29:09.648457 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 551/1183] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:09 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 37425 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:09.673095 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f6453a60-2711-41a6-9999-6d54c3876b8e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:09.673708 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f6453a60-2711-41a6-9999-6d54c3876b8e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:09.680300 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f6453a60-2711-41a6-9999-6d54c3876b8e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:09.680677 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f6453a60-2711-41a6-9999-6d54c3876b8e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:09.681450 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f6453a60-2711-41a6-9999-6d54c3876b8e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:09.681876 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f6453a60-2711-41a6-9999-6d54c3876b8e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:09.823188 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f6453a60-2711-41a6-9999-6d54c3876b8e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:09.831891 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f6453a60-2711-41a6-9999-6d54c3876b8e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1266 microversion: 2.1 time: 0.163430 Nov 19 03:29:09.832478 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 633/1184] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:09 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:29:10.002691 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-1784aac6-e6b9-45c2-972e-a716f9ab4fd9 req-dd6563b5-2814-4e11-93b1-d99e7d1d0b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2791816b-a24f-4393-b909-931a52e455a1", "tag": "ad396234-a82d-422a-9ca4-4d3f85240b28"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:10.009854 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:29:10.009854 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:29:10.020826 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-1784aac6-e6b9-45c2-972e-a716f9ab4fd9 req-dd6563b5-2814-4e11-93b1-d99e7d1d0b1b service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:10.021702 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-1784aac6-e6b9-45c2-972e-a716f9ab4fd9 req-dd6563b5-2814-4e11-93b1-d99e7d1d0b1b service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:10.038732 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-1784aac6-e6b9-45c2-972e-a716f9ab4fd9 req-dd6563b5-2814-4e11-93b1-d99e7d1d0b1b service nova] Creating event network-changed:ad396234-a82d-422a-9ca4-4d3f85240b28 for instance 2791816b-a24f-4393-b909-931a52e455a1 on hv-cinder-81803 Nov 19 03:29:10.043959 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-1784aac6-e6b9-45c2-972e-a716f9ab4fd9 req-dd6563b5-2814-4e11-93b1-d99e7d1d0b1b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046254 Nov 19 03:29:10.044870 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 552/1185] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:29:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:29:10.659081 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-16ab0325-6802-422a-bbac-78709afe1825 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:10.660146 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-16ab0325-6802-422a-bbac-78709afe1825 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:10.667041 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-16ab0325-6802-422a-bbac-78709afe1825 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:10.667501 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-16ab0325-6802-422a-bbac-78709afe1825 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:10.668294 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-16ab0325-6802-422a-bbac-78709afe1825 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:10.668759 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-16ab0325-6802-422a-bbac-78709afe1825 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:10.849652 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-16e947aa-b516-4fed-bbe2-9c76d0839aa1 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:10.850370 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-16e947aa-b516-4fed-bbe2-9c76d0839aa1 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:10.856544 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-16e947aa-b516-4fed-bbe2-9c76d0839aa1 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:10.856986 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-16e947aa-b516-4fed-bbe2-9c76d0839aa1 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:10.858538 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-16e947aa-b516-4fed-bbe2-9c76d0839aa1 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:10.858977 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-16e947aa-b516-4fed-bbe2-9c76d0839aa1 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:10.881553 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-16ab0325-6802-422a-bbac-78709afe1825 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 38181 microversion: 2.1 time: 0.226256 Nov 19 03:29:10.886003 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 634/1186] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:10 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 38181 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:11.062636 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-16e947aa-b516-4fed-bbe2-9c76d0839aa1 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:11.069895 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-16e947aa-b516-4fed-bbe2-9c76d0839aa1 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1266 microversion: 2.1 time: 0.224710 Nov 19 03:29:11.070843 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 553/1187] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:10 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:29:11.893711 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7cc3565b-abdf-428a-b6b3-15bf71b952dc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:11.894752 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7cc3565b-abdf-428a-b6b3-15bf71b952dc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:11.902014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7cc3565b-abdf-428a-b6b3-15bf71b952dc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:11.902486 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7cc3565b-abdf-428a-b6b3-15bf71b952dc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:11.903286 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7cc3565b-abdf-428a-b6b3-15bf71b952dc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:11.903727 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7cc3565b-abdf-428a-b6b3-15bf71b952dc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:11.990683 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7cc3565b-abdf-428a-b6b3-15bf71b952dc tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 38181 microversion: 2.1 time: 0.100855 Nov 19 03:29:11.991324 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 635/1188] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:11 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 38181 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:12.086407 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-94e6e65e-4a94-4dd6-a9b4-155fb8d05842 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:12.087045 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-94e6e65e-4a94-4dd6-a9b4-155fb8d05842 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:12.094398 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-94e6e65e-4a94-4dd6-a9b4-155fb8d05842 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:12.094932 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-94e6e65e-4a94-4dd6-a9b4-155fb8d05842 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:12.095707 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-94e6e65e-4a94-4dd6-a9b4-155fb8d05842 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:12.096140 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-94e6e65e-4a94-4dd6-a9b4-155fb8d05842 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:12.227833 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-94e6e65e-4a94-4dd6-a9b4-155fb8d05842 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:12.235457 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-94e6e65e-4a94-4dd6-a9b4-155fb8d05842 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1266 microversion: 2.1 time: 0.152617 Nov 19 03:29:12.236049 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 554/1189] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:12 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:13.003557 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-da31fe2c-ed7c-45b3-acd1-7d54f6da5874 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:13.004554 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-da31fe2c-ed7c-45b3-acd1-7d54f6da5874 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:13.011419 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da31fe2c-ed7c-45b3-acd1-7d54f6da5874 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:13.011866 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da31fe2c-ed7c-45b3-acd1-7d54f6da5874 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:13.012647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da31fe2c-ed7c-45b3-acd1-7d54f6da5874 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:13.013081 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-da31fe2c-ed7c-45b3-acd1-7d54f6da5874 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:13.106743 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-da31fe2c-ed7c-45b3-acd1-7d54f6da5874 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 38181 microversion: 2.1 time: 0.107040 Nov 19 03:29:13.107925 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 636/1190] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:12 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 38181 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:13.252491 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-be1784e9-fab8-4932-a6d6-e156ea49e291 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:13.253135 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-be1784e9-fab8-4932-a6d6-e156ea49e291 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:13.259408 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be1784e9-fab8-4932-a6d6-e156ea49e291 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:13.259847 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be1784e9-fab8-4932-a6d6-e156ea49e291 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:13.260606 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be1784e9-fab8-4932-a6d6-e156ea49e291 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:13.261030 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-be1784e9-fab8-4932-a6d6-e156ea49e291 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:13.390039 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-be1784e9-fab8-4932-a6d6-e156ea49e291 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:13.397341 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-be1784e9-fab8-4932-a6d6-e156ea49e291 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1266 microversion: 2.1 time: 0.149023 Nov 19 03:29:13.397889 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 555/1191] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:13 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:14.119574 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d06a5bc0-2ae0-453e-ad68-c03ffc77bf7c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:14.120575 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d06a5bc0-2ae0-453e-ad68-c03ffc77bf7c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:14.128143 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d06a5bc0-2ae0-453e-ad68-c03ffc77bf7c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:14.128594 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d06a5bc0-2ae0-453e-ad68-c03ffc77bf7c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:14.129374 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d06a5bc0-2ae0-453e-ad68-c03ffc77bf7c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:14.129816 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d06a5bc0-2ae0-453e-ad68-c03ffc77bf7c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:14.219266 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d06a5bc0-2ae0-453e-ad68-c03ffc77bf7c tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 38194 microversion: 2.1 time: 0.103605 Nov 19 03:29:14.219906 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 637/1192] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:14 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 38194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:14.414629 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3759fee0-fa79-4bca-8761-9091360d6fa0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:14.415428 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3759fee0-fa79-4bca-8761-9091360d6fa0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:14.422152 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3759fee0-fa79-4bca-8761-9091360d6fa0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:14.422635 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3759fee0-fa79-4bca-8761-9091360d6fa0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:14.423405 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3759fee0-fa79-4bca-8761-9091360d6fa0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:14.423838 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3759fee0-fa79-4bca-8761-9091360d6fa0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:14.557374 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-3759fee0-fa79-4bca-8761-9091360d6fa0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:14.565433 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3759fee0-fa79-4bca-8761-9091360d6fa0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1266 microversion: 2.1 time: 0.154633 Nov 19 03:29:14.565989 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 556/1193] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:14 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:15.231048 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d43c06de-c531-447c-9623-fb34ccdc7297 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:15.232075 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d43c06de-c531-447c-9623-fb34ccdc7297 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:15.238989 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d43c06de-c531-447c-9623-fb34ccdc7297 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:15.239438 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d43c06de-c531-447c-9623-fb34ccdc7297 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:15.240224 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d43c06de-c531-447c-9623-fb34ccdc7297 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:15.240648 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d43c06de-c531-447c-9623-fb34ccdc7297 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:15.329575 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d43c06de-c531-447c-9623-fb34ccdc7297 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action" status: 200 len: 38310 microversion: 2.1 time: 0.102436 Nov 19 03:29:15.330394 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 638/1194] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:29:15 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/action => generated 38310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 03:29:15.339867 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-fbab7a1e-7226-4bfd-a6ed-1d19f50f56a6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:15.340349 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-fbab7a1e-7226-4bfd-a6ed-1d19f50f56a6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:15.347007 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fbab7a1e-7226-4bfd-a6ed-1d19f50f56a6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:15.347450 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fbab7a1e-7226-4bfd-a6ed-1d19f50f56a6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:15.348206 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fbab7a1e-7226-4bfd-a6ed-1d19f50f56a6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:15.348629 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fbab7a1e-7226-4bfd-a6ed-1d19f50f56a6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:15.370680 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-fbab7a1e-7226-4bfd-a6ed-1d19f50f56a6 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/ips" status: 200 len: 147 microversion: 2.1 time: 0.034357 Nov 19 03:29:15.371222 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 557/1195] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Nov 19 03:29:15 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/ips => generated 147 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:29:15.584228 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-71933bef-580c-4102-ba3e-508618e74f1e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:15.585066 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-71933bef-580c-4102-ba3e-508618e74f1e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:15.591972 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71933bef-580c-4102-ba3e-508618e74f1e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:15.592519 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71933bef-580c-4102-ba3e-508618e74f1e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:15.593297 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71933bef-580c-4102-ba3e-508618e74f1e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:15.593726 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-71933bef-580c-4102-ba3e-508618e74f1e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:15.734656 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-71933bef-580c-4102-ba3e-508618e74f1e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:15.741858 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-71933bef-580c-4102-ba3e-508618e74f1e tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1266 microversion: 2.1 time: 0.161713 Nov 19 03:29:15.742421 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 639/1196] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:15 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:16.678847 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d632e92b-c6e5-46b2-950f-4a0d27a9ad8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d80e43b-af66-4a69-b4e7-48b03331f993"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:16.679885 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d632e92b-c6e5-46b2-950f-4a0d27a9ad8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:16.686159 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d632e92b-c6e5-46b2-950f-4a0d27a9ad8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:16.686632 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d632e92b-c6e5-46b2-950f-4a0d27a9ad8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:16.687390 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d632e92b-c6e5-46b2-950f-4a0d27a9ad8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:16.687810 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d632e92b-c6e5-46b2-950f-4a0d27a9ad8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:16.758904 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ebc1bcd8-8c79-4292-aa0c-5584081f1c33 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:16.759533 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ebc1bcd8-8c79-4292-aa0c-5584081f1c33 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:16.768014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ebc1bcd8-8c79-4292-aa0c-5584081f1c33 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:16.768686 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ebc1bcd8-8c79-4292-aa0c-5584081f1c33 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:16.769642 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ebc1bcd8-8c79-4292-aa0c-5584081f1c33 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:16.770227 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ebc1bcd8-8c79-4292-aa0c-5584081f1c33 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:16.911159 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-ebc1bcd8-8c79-4292-aa0c-5584081f1c33 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:16.918779 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ebc1bcd8-8c79-4292-aa0c-5584081f1c33 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1266 microversion: 2.1 time: 0.163426 Nov 19 03:29:16.919421 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 640/1197] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:16 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:29:16.934874 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d632e92b-c6e5-46b2-950f-4a0d27a9ad8d tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259503 Nov 19 03:29:16.935596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 558/1198] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:29:16 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:29:17.935152 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-42e74f3b-58f4-4a40-9ed7-51fc6286b240 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:17.935886 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-42e74f3b-58f4-4a40-9ed7-51fc6286b240 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:17.941891 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-42e74f3b-58f4-4a40-9ed7-51fc6286b240 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:17.942332 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-42e74f3b-58f4-4a40-9ed7-51fc6286b240 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:17.943159 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-42e74f3b-58f4-4a40-9ed7-51fc6286b240 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:17.943591 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-42e74f3b-58f4-4a40-9ed7-51fc6286b240 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:18.074615 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-42e74f3b-58f4-4a40-9ed7-51fc6286b240 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:18.082369 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-42e74f3b-58f4-4a40-9ed7-51fc6286b240 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1266 microversion: 2.1 time: 0.150873 Nov 19 03:29:18.082978 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 641/1199] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:17 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:19.099886 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-89dceff4-b84b-450a-86bb-926f362ce81d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:19.100613 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-89dceff4-b84b-450a-86bb-926f362ce81d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:19.106709 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-89dceff4-b84b-450a-86bb-926f362ce81d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:19.107160 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-89dceff4-b84b-450a-86bb-926f362ce81d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:19.108001 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-89dceff4-b84b-450a-86bb-926f362ce81d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:19.108434 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-89dceff4-b84b-450a-86bb-926f362ce81d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:19.236052 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-89dceff4-b84b-450a-86bb-926f362ce81d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:19.243312 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-89dceff4-b84b-450a-86bb-926f362ce81d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1266 microversion: 2.1 time: 0.147863 Nov 19 03:29:19.243881 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 559/1200] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:19 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:20.260771 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f3915724-32a9-4e93-b65a-0a5b6b0293c0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:20.261385 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f3915724-32a9-4e93-b65a-0a5b6b0293c0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:20.268439 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3915724-32a9-4e93-b65a-0a5b6b0293c0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:20.268892 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3915724-32a9-4e93-b65a-0a5b6b0293c0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:20.269681 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3915724-32a9-4e93-b65a-0a5b6b0293c0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:20.270120 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3915724-32a9-4e93-b65a-0a5b6b0293c0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:20.403261 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f3915724-32a9-4e93-b65a-0a5b6b0293c0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:20.410563 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f3915724-32a9-4e93-b65a-0a5b6b0293c0 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1266 microversion: 2.1 time: 0.153498 Nov 19 03:29:20.411125 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 642/1201] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:20 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:21.427942 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a06b3bae-140b-4bf1-b108-068332b78857 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:21.428490 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a06b3bae-140b-4bf1-b108-068332b78857 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:21.434719 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a06b3bae-140b-4bf1-b108-068332b78857 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:21.435158 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a06b3bae-140b-4bf1-b108-068332b78857 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:21.435918 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a06b3bae-140b-4bf1-b108-068332b78857 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:21.436341 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a06b3bae-140b-4bf1-b108-068332b78857 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:21.566385 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a06b3bae-140b-4bf1-b108-068332b78857 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:21.573509 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a06b3bae-140b-4bf1-b108-068332b78857 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1266 microversion: 2.1 time: 0.149239 Nov 19 03:29:21.574064 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 560/1202] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:21 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:22.129903 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-3e0e793c-f0da-49c0-8682-86d85534669d req-f4c771ae-d163-44a4-a9ec-90eaf330091f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2791816b-a24f-4393-b909-931a52e455a1", "name": "network-vif-plugged", "status": "completed", "tag": "ad396234-a82d-422a-9ca4-4d3f85240b28"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:22.131890 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:29:22.131890 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:29:22.139995 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-3e0e793c-f0da-49c0-8682-86d85534669d req-f4c771ae-d163-44a4-a9ec-90eaf330091f service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:22.140600 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-3e0e793c-f0da-49c0-8682-86d85534669d req-f4c771ae-d163-44a4-a9ec-90eaf330091f service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:22.151438 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-3e0e793c-f0da-49c0-8682-86d85534669d req-f4c771ae-d163-44a4-a9ec-90eaf330091f service nova] Creating event network-vif-plugged:ad396234-a82d-422a-9ca4-4d3f85240b28 for instance 2791816b-a24f-4393-b909-931a52e455a1 on hv-cinder-81803 Nov 19 03:29:22.156570 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-3e0e793c-f0da-49c0-8682-86d85534669d req-f4c771ae-d163-44a4-a9ec-90eaf330091f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030317 Nov 19 03:29:22.157143 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 643/1203] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:29:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:29:22.591471 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b14cf68c-b37b-4f60-8bda-267ec69ba56b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:22.592191 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b14cf68c-b37b-4f60-8bda-267ec69ba56b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:22.598858 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b14cf68c-b37b-4f60-8bda-267ec69ba56b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:22.599303 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b14cf68c-b37b-4f60-8bda-267ec69ba56b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:22.600073 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b14cf68c-b37b-4f60-8bda-267ec69ba56b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:22.600533 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b14cf68c-b37b-4f60-8bda-267ec69ba56b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:22.739441 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b14cf68c-b37b-4f60-8bda-267ec69ba56b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:22.746678 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b14cf68c-b37b-4f60-8bda-267ec69ba56b tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1266 microversion: 2.1 time: 0.158870 Nov 19 03:29:22.747244 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 561/1204] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:22 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:23.765953 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7fdca920-6c05-4c10-a3ca-621860e4fa72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:23.766789 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7fdca920-6c05-4c10-a3ca-621860e4fa72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:23.773067 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7fdca920-6c05-4c10-a3ca-621860e4fa72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:23.773575 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7fdca920-6c05-4c10-a3ca-621860e4fa72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:23.774611 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7fdca920-6c05-4c10-a3ca-621860e4fa72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:23.775050 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7fdca920-6c05-4c10-a3ca-621860e4fa72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:23.915967 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7fdca920-6c05-4c10-a3ca-621860e4fa72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:23.924777 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7fdca920-6c05-4c10-a3ca-621860e4fa72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1266 microversion: 2.1 time: 0.163363 Nov 19 03:29:23.925346 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 644/1205] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:23 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:24.399358 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5c32fb09-528a-4538-b842-9bc5832da1f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:24.400271 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5c32fb09-528a-4538-b842-9bc5832da1f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:24.407248 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5c32fb09-528a-4538-b842-9bc5832da1f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:24.407699 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5c32fb09-528a-4538-b842-9bc5832da1f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:24.408472 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5c32fb09-528a-4538-b842-9bc5832da1f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:24.408904 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5c32fb09-528a-4538-b842-9bc5832da1f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:24.437461 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5c32fb09-528a-4538-b842-9bc5832da1f8 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041750 Nov 19 03:29:24.438001 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 562/1206] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:29:24 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:29:24.447404 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-381fc738-fa7d-4eaa-8bd1-aa6269a50523 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:24.447900 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-381fc738-fa7d-4eaa-8bd1-aa6269a50523 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:24.454334 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-381fc738-fa7d-4eaa-8bd1-aa6269a50523 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:24.454803 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-381fc738-fa7d-4eaa-8bd1-aa6269a50523 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:24.455577 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-381fc738-fa7d-4eaa-8bd1-aa6269a50523 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:24.456013 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-381fc738-fa7d-4eaa-8bd1-aa6269a50523 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:24.483901 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-381fc738-fa7d-4eaa-8bd1-aa6269a50523 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments/1d80e43b-af66-4a69-b4e7-48b03331f993" status: 200 len: 194 microversion: 2.1 time: 0.040214 Nov 19 03:29:24.484462 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 645/1207] 10.222.0.47 () {58 vars in 1412 bytes} [Fri Nov 19 03:29:24 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments/1d80e43b-af66-4a69-b4e7-48b03331f993 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:29:24.941104 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-514515e6-5c0d-4f2d-be78-83e1d32744cf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:24.941621 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-514515e6-5c0d-4f2d-be78-83e1d32744cf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:24.947593 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-514515e6-5c0d-4f2d-be78-83e1d32744cf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:24.948038 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-514515e6-5c0d-4f2d-be78-83e1d32744cf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:24.948813 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-514515e6-5c0d-4f2d-be78-83e1d32744cf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:24.949433 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-514515e6-5c0d-4f2d-be78-83e1d32744cf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:25.092502 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-514515e6-5c0d-4f2d-be78-83e1d32744cf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:25.100591 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-514515e6-5c0d-4f2d-be78-83e1d32744cf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1453 microversion: 2.1 time: 0.163353 Nov 19 03:29:25.101158 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 563/1208] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:24 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:25.116156 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a3d13878-5a96-4285-b8d9-bead70fb064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:25.116770 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a3d13878-5a96-4285-b8d9-bead70fb064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:25.123066 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a3d13878-5a96-4285-b8d9-bead70fb064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:25.123513 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a3d13878-5a96-4285-b8d9-bead70fb064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:25.124313 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a3d13878-5a96-4285-b8d9-bead70fb064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:25.124838 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a3d13878-5a96-4285-b8d9-bead70fb064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:25.254834 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a3d13878-5a96-4285-b8d9-bead70fb064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:25.262021 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a3d13878-5a96-4285-b8d9-bead70fb064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1453 microversion: 2.1 time: 0.149536 Nov 19 03:29:25.262609 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 646/1209] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:25 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:25.785922 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-698ea2ea-7c70-4da4-86df-0c3c54c2574e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06c61c14-04b2-4b9b-a7e4-f314ca567634"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:25.787007 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-698ea2ea-7c70-4da4-86df-0c3c54c2574e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:25.793537 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-698ea2ea-7c70-4da4-86df-0c3c54c2574e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:25.793978 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-698ea2ea-7c70-4da4-86df-0c3c54c2574e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:25.794774 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-698ea2ea-7c70-4da4-86df-0c3c54c2574e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:25.795200 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-698ea2ea-7c70-4da4-86df-0c3c54c2574e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:26.046913 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-698ea2ea-7c70-4da4-86df-0c3c54c2574e tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265496 Nov 19 03:29:26.047654 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 564/1210] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:29:25 2021] POST /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:29:27.165561 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-5e2ea1fb-245e-4887-99e9-0751f9fb80fc req-702822ab-df0b-4121-a1b0-8676e9108f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2791816b-a24f-4393-b909-931a52e455a1", "tag": "ad396234-a82d-422a-9ca4-4d3f85240b28"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:27.167074 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:29:27.167074 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:29:27.174900 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-5e2ea1fb-245e-4887-99e9-0751f9fb80fc req-702822ab-df0b-4121-a1b0-8676e9108f0c service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:27.175340 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-5e2ea1fb-245e-4887-99e9-0751f9fb80fc req-702822ab-df0b-4121-a1b0-8676e9108f0c service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:27.186051 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-5e2ea1fb-245e-4887-99e9-0751f9fb80fc req-702822ab-df0b-4121-a1b0-8676e9108f0c service nova] Creating event network-changed:ad396234-a82d-422a-9ca4-4d3f85240b28 for instance 2791816b-a24f-4393-b909-931a52e455a1 on hv-cinder-81803 Nov 19 03:29:27.191045 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-5e2ea1fb-245e-4887-99e9-0751f9fb80fc req-702822ab-df0b-4121-a1b0-8676e9108f0c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029248 Nov 19 03:29:27.191633 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 647/1211] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:29:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:29:33.512953 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3dfb9166-ab7c-4a56-9c25-601da90302c7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:33.513995 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3dfb9166-ab7c-4a56-9c25-601da90302c7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:33.520348 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3dfb9166-ab7c-4a56-9c25-601da90302c7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:33.520798 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3dfb9166-ab7c-4a56-9c25-601da90302c7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:33.521566 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3dfb9166-ab7c-4a56-9c25-601da90302c7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:33.521999 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3dfb9166-ab7c-4a56-9c25-601da90302c7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:33.552146 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3dfb9166-ab7c-4a56-9c25-601da90302c7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043706 Nov 19 03:29:33.552633 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 565/1212] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:29:33 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:29:33.797128 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f177cd43-2595-4f22-aad7-61132cd3ec88 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:33.798023 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f177cd43-2595-4f22-aad7-61132cd3ec88 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:33.804953 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f177cd43-2595-4f22-aad7-61132cd3ec88 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:33.805369 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f177cd43-2595-4f22-aad7-61132cd3ec88 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:33.806144 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f177cd43-2595-4f22-aad7-61132cd3ec88 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:33.806609 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f177cd43-2595-4f22-aad7-61132cd3ec88 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:33.834115 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f177cd43-2595-4f22-aad7-61132cd3ec88 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments/1d80e43b-af66-4a69-b4e7-48b03331f993" status: 200 len: 194 microversion: 2.1 time: 0.041583 Nov 19 03:29:33.834716 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 648/1213] 10.222.0.47 () {58 vars in 1412 bytes} [Fri Nov 19 03:29:33 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments/1d80e43b-af66-4a69-b4e7-48b03331f993 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:29:33.843848 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-bcc5a4dd-d0fa-4719-89da-913f0be277cd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:33.844869 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-bcc5a4dd-d0fa-4719-89da-913f0be277cd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:33.851005 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bcc5a4dd-d0fa-4719-89da-913f0be277cd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:33.851441 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bcc5a4dd-d0fa-4719-89da-913f0be277cd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:33.852195 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bcc5a4dd-d0fa-4719-89da-913f0be277cd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:33.852618 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-bcc5a4dd-d0fa-4719-89da-913f0be277cd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:33.928735 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.objects.instance [None req-bcc5a4dd-d0fa-4719-89da-913f0be277cd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lazy-loading 'services' on Instance uuid 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 {{(pid=116066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:29:33.999696 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-bcc5a4dd-d0fa-4719-89da-913f0be277cd tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "DELETE /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments/1d80e43b-af66-4a69-b4e7-48b03331f993" status: 202 len: 0 microversion: 2.1 time: 0.159338 Nov 19 03:29:34.000585 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 566/1214] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Nov 19 03:29:33 2021] DELETE /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments/1d80e43b-af66-4a69-b4e7-48b03331f993 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:29:36.157786 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1b136c48-dc4f-4f71-8b70-61b802f0b9f5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:36.158326 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1b136c48-dc4f-4f71-8b70-61b802f0b9f5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:36.164667 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1b136c48-dc4f-4f71-8b70-61b802f0b9f5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:36.165111 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1b136c48-dc4f-4f71-8b70-61b802f0b9f5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:36.166145 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1b136c48-dc4f-4f71-8b70-61b802f0b9f5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:36.166617 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1b136c48-dc4f-4f71-8b70-61b802f0b9f5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:36.194725 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1b136c48-dc4f-4f71-8b70-61b802f0b9f5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments/06c61c14-04b2-4b9b-a7e4-f314ca567634" status: 200 len: 194 microversion: 2.1 time: 0.041633 Nov 19 03:29:36.195296 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 649/1215] 10.222.0.47 () {58 vars in 1412 bytes} [Fri Nov 19 03:29:36 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments/06c61c14-04b2-4b9b-a7e4-f314ca567634 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:29:36.206565 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ef700d10-1511-4bf8-8ab0-ad3afc837767 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:36.207315 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ef700d10-1511-4bf8-8ab0-ad3afc837767 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:36.213338 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ef700d10-1511-4bf8-8ab0-ad3afc837767 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:36.213778 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ef700d10-1511-4bf8-8ab0-ad3afc837767 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:36.214558 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ef700d10-1511-4bf8-8ab0-ad3afc837767 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:36.214982 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ef700d10-1511-4bf8-8ab0-ad3afc837767 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:36.291481 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.objects.instance [None req-ef700d10-1511-4bf8-8ab0-ad3afc837767 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lazy-loading 'services' on Instance uuid 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 {{(pid=116066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:29:36.361294 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ef700d10-1511-4bf8-8ab0-ad3afc837767 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "DELETE /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments/06c61c14-04b2-4b9b-a7e4-f314ca567634" status: 202 len: 0 microversion: 2.1 time: 0.159857 Nov 19 03:29:36.362082 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 567/1216] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Nov 19 03:29:36 2021] DELETE /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments/06c61c14-04b2-4b9b-a7e4-f314ca567634 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:29:37.508864 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-14fb9303-2b46-41c6-9827-2b4d13e60a42 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:37.509779 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-14fb9303-2b46-41c6-9827-2b4d13e60a42 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:37.516413 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-14fb9303-2b46-41c6-9827-2b4d13e60a42 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:37.516891 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-14fb9303-2b46-41c6-9827-2b4d13e60a42 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:37.517671 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-14fb9303-2b46-41c6-9827-2b4d13e60a42 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:37.518107 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-14fb9303-2b46-41c6-9827-2b4d13e60a42 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:37.546953 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-14fb9303-2b46-41c6-9827-2b4d13e60a42 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041722 Nov 19 03:29:37.548235 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 650/1217] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:29:37 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:29:37.648336 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9cf1bcc5-bfb3-413b-99d8-bbbc31f427da tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:37.649350 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9cf1bcc5-bfb3-413b-99d8-bbbc31f427da tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:37.655312 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9cf1bcc5-bfb3-413b-99d8-bbbc31f427da tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:37.655760 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9cf1bcc5-bfb3-413b-99d8-bbbc31f427da tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:37.657150 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9cf1bcc5-bfb3-413b-99d8-bbbc31f427da tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:37.657584 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9cf1bcc5-bfb3-413b-99d8-bbbc31f427da tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:37.685294 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9cf1bcc5-bfb3-413b-99d8-bbbc31f427da tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041697 Nov 19 03:29:37.685837 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 568/1218] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Nov 19 03:29:37 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 03:29:37.740207 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ede37d64-ddd6-47ba-b7d1-9f1e1e812789 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:37.740705 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ede37d64-ddd6-47ba-b7d1-9f1e1e812789 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:37.746559 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ede37d64-ddd6-47ba-b7d1-9f1e1e812789 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:37.747013 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ede37d64-ddd6-47ba-b7d1-9f1e1e812789 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:37.747814 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ede37d64-ddd6-47ba-b7d1-9f1e1e812789 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:37.748252 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ede37d64-ddd6-47ba-b7d1-9f1e1e812789 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:37.773437 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ede37d64-ddd6-47ba-b7d1-9f1e1e812789 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Going to try to terminate instance {{(pid=116065) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:29:37.845571 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ede37d64-ddd6-47ba-b7d1-9f1e1e812789 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "DELETE /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 204 len: 0 microversion: 2.1 time: 0.109453 Nov 19 03:29:37.846160 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 651/1219] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:29:37 2021] DELETE /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 03:29:37.854192 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d7d8c3de-473f-4ff6-ac4a-987fba8619d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:37.854834 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d7d8c3de-473f-4ff6-ac4a-987fba8619d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:37.860927 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7d8c3de-473f-4ff6-ac4a-987fba8619d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:37.861374 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7d8c3de-473f-4ff6-ac4a-987fba8619d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:37.862139 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7d8c3de-473f-4ff6-ac4a-987fba8619d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:37.862598 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d7d8c3de-473f-4ff6-ac4a-987fba8619d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:37.992991 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d7d8c3de-473f-4ff6-ac4a-987fba8619d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:38.000918 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d7d8c3de-473f-4ff6-ac4a-987fba8619d0 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1675 microversion: 2.1 time: 0.149666 Nov 19 03:29:38.001485 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 569/1220] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:37 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:39.018490 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e69ac8f8-c402-4e5e-b63d-0df6200117b7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:39.019200 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e69ac8f8-c402-4e5e-b63d-0df6200117b7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:39.025428 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e69ac8f8-c402-4e5e-b63d-0df6200117b7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:39.025875 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e69ac8f8-c402-4e5e-b63d-0df6200117b7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:39.026679 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e69ac8f8-c402-4e5e-b63d-0df6200117b7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:39.027114 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e69ac8f8-c402-4e5e-b63d-0df6200117b7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:39.162214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e69ac8f8-c402-4e5e-b63d-0df6200117b7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:39.169760 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e69ac8f8-c402-4e5e-b63d-0df6200117b7 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1675 microversion: 2.1 time: 0.155602 Nov 19 03:29:39.170324 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 652/1221] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:39 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:40.192247 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e4484b51-1bd2-4c1d-b3a6-162c14b2cb29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:40.192853 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e4484b51-1bd2-4c1d-b3a6-162c14b2cb29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:40.199127 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e4484b51-1bd2-4c1d-b3a6-162c14b2cb29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:40.199565 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e4484b51-1bd2-4c1d-b3a6-162c14b2cb29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:40.200329 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e4484b51-1bd2-4c1d-b3a6-162c14b2cb29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:40.200757 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e4484b51-1bd2-4c1d-b3a6-162c14b2cb29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:40.361610 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e4484b51-1bd2-4c1d-b3a6-162c14b2cb29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:40.369103 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e4484b51-1bd2-4c1d-b3a6-162c14b2cb29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1675 microversion: 2.1 time: 0.180321 Nov 19 03:29:40.369553 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 570/1222] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:40 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:41.173097 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-7a3c58c5-a757-453c-813d-3ee0babda4fc req-f6fe4498-0b66-4a2f-8c95-c8d34bbfe8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d25e92-7d0e-4a2a-8c3c-b5a5f296c502", "name": "network-vif-deleted", "tag": "f7a46174-e8bc-466b-af2e-40c5bc49b38d"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:41.174911 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:29:41.174911 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:29:41.182808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-7a3c58c5-a757-453c-813d-3ee0babda4fc req-f6fe4498-0b66-4a2f-8c95-c8d34bbfe8ed service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:41.183255 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-7a3c58c5-a757-453c-813d-3ee0babda4fc req-f6fe4498-0b66-4a2f-8c95-c8d34bbfe8ed service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:41.195166 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-7a3c58c5-a757-453c-813d-3ee0babda4fc req-f6fe4498-0b66-4a2f-8c95-c8d34bbfe8ed service nova] Creating event network-vif-deleted:f7a46174-e8bc-466b-af2e-40c5bc49b38d for instance 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 on hv-cinder-81803 Nov 19 03:29:41.200095 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-7a3c58c5-a757-453c-813d-3ee0babda4fc req-f6fe4498-0b66-4a2f-8c95-c8d34bbfe8ed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031397 Nov 19 03:29:41.201014 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 653/1223] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:29:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:29:41.386796 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3c56fefd-0862-4695-9ba4-669ebd26b0be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:41.387402 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3c56fefd-0862-4695-9ba4-669ebd26b0be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:41.394998 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3c56fefd-0862-4695-9ba4-669ebd26b0be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:41.395559 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3c56fefd-0862-4695-9ba4-669ebd26b0be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:41.396442 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3c56fefd-0862-4695-9ba4-669ebd26b0be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:41.396943 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3c56fefd-0862-4695-9ba4-669ebd26b0be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:41.429863 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3c56fefd-0862-4695-9ba4-669ebd26b0be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:41.430311 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3c56fefd-0862-4695-9ba4-669ebd26b0be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:41.430788 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.objects.instance [None req-3c56fefd-0862-4695-9ba4-669ebd26b0be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lazy-loading 'fault' on Instance uuid 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 {{(pid=116066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:29:41.471061 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-3c56fefd-0862-4695-9ba4-669ebd26b0be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f233fb185241e8a04f8ce5d27c0bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d64b0b6d824dcaa62fc05f714c4d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:41.478401 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3c56fefd-0862-4695-9ba4-669ebd26b0be tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 200 len: 1327 microversion: 2.1 time: 0.095241 Nov 19 03:29:41.479010 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 571/1224] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:41 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:42.496330 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9ea2fba1-60f6-42e6-a56b-2f65bc194f11 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:42.497033 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9ea2fba1-60f6-42e6-a56b-2f65bc194f11 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:42.503636 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9ea2fba1-60f6-42e6-a56b-2f65bc194f11 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:42.504092 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9ea2fba1-60f6-42e6-a56b-2f65bc194f11 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:42.504943 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9ea2fba1-60f6-42e6-a56b-2f65bc194f11 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:42.505378 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9ea2fba1-60f6-42e6-a56b-2f65bc194f11 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:42.518811 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-9ea2fba1-60f6-42e6-a56b-2f65bc194f11 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] HTTP exception thrown: Instance 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 could not be found. Nov 19 03:29:42.519381 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9ea2fba1-60f6-42e6-a56b-2f65bc194f11 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Returning 404 to user: Instance 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:29:42.520177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9ea2fba1-60f6-42e6-a56b-2f65bc194f11 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 404 len: 111 microversion: 2.1 time: 0.028368 Nov 19 03:29:42.520693 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 654/1225] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:42 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:29:42.528626 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ac8ec2bb-b525-4d42-9f5d-9dc5b07e1a22 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '.version_select at 0x7f845a0ccee0>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:42.545539 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ac8ec2bb-b525-4d42-9f5d-9dc5b07e1a22 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949391301" status: 202 len: 0 microversion: 2.1 time: 0.020443 Nov 19 03:29:42.546121 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 572/1226] 10.222.0.47 () {58 vars in 1220 bytes} [Fri Nov 19 03:29:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949391301 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:29:45.420007 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0c145495-3610-4910-88b9-941ce91d0e60 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:45.420515 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0c145495-3610-4910-88b9-941ce91d0e60 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:45.427578 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0c145495-3610-4910-88b9-941ce91d0e60 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:45.428035 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0c145495-3610-4910-88b9-941ce91d0e60 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:45.428811 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0c145495-3610-4910-88b9-941ce91d0e60 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:45.429252 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0c145495-3610-4910-88b9-941ce91d0e60 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:45.442810 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-0c145495-3610-4910-88b9-941ce91d0e60 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] HTTP exception thrown: Instance 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 could not be found. Nov 19 03:29:45.443383 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0c145495-3610-4910-88b9-941ce91d0e60 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Returning 404 to user: Instance 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:29:45.444191 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0c145495-3610-4910-88b9-941ce91d0e60 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "DELETE /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 404 len: 111 microversion: 2.1 time: 0.028136 Nov 19 03:29:45.444707 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 655/1227] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:29:45 2021] DELETE /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:29:45.452662 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f3c5cc35-75fc-4dc6-9f2b-6df99a1386e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:45.453264 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f3c5cc35-75fc-4dc6-9f2b-6df99a1386e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:45.459814 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f3c5cc35-75fc-4dc6-9f2b-6df99a1386e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:45.460258 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f3c5cc35-75fc-4dc6-9f2b-6df99a1386e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:45.461034 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f3c5cc35-75fc-4dc6-9f2b-6df99a1386e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:45.461467 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f3c5cc35-75fc-4dc6-9f2b-6df99a1386e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:45.473992 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-f3c5cc35-75fc-4dc6-9f2b-6df99a1386e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] HTTP exception thrown: Instance 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 could not be found. Nov 19 03:29:45.474595 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f3c5cc35-75fc-4dc6-9f2b-6df99a1386e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Returning 404 to user: Instance 93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:29:45.475402 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f3c5cc35-75fc-4dc6-9f2b-6df99a1386e5 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502" status: 404 len: 111 microversion: 2.1 time: 0.026811 Nov 19 03:29:45.475926 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 573/1228] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:45 2021] GET /compute/v2.1/servers/93d25e92-7d0e-4a2a-8c3c-b5a5f296c502 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:29:46.601279 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e9f9ed46-b517-4cce-a599-a8a34a628b29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:46.601812 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e9f9ed46-b517-4cce-a599-a8a34a628b29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:46.608065 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e9f9ed46-b517-4cce-a599-a8a34a628b29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:46.608552 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e9f9ed46-b517-4cce-a599-a8a34a628b29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:46.609360 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e9f9ed46-b517-4cce-a599-a8a34a628b29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:46.610550 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e9f9ed46-b517-4cce-a599-a8a34a628b29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:46.625122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-e9f9ed46-b517-4cce-a599-a8a34a628b29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] HTTP exception thrown: Instance 5741fba7-f551-445e-833f-303eca2c8dae could not be found. Nov 19 03:29:46.625937 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e9f9ed46-b517-4cce-a599-a8a34a628b29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Returning 404 to user: Instance 5741fba7-f551-445e-833f-303eca2c8dae could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:29:46.626778 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e9f9ed46-b517-4cce-a599-a8a34a628b29 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 404 len: 111 microversion: 2.1 time: 0.029243 Nov 19 03:29:46.627302 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 656/1229] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:29:46 2021] DELETE /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:29:46.635088 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-56f74874-d9b0-496b-af02-890aebc8ad03 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:46.635685 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-56f74874-d9b0-496b-af02-890aebc8ad03 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] [instance: 5741fba7-f551-445e-833f-303eca2c8dae] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:46.642833 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-56f74874-d9b0-496b-af02-890aebc8ad03 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:46.643491 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-56f74874-d9b0-496b-af02-890aebc8ad03 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:46.644263 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-56f74874-d9b0-496b-af02-890aebc8ad03 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:46.644689 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-56f74874-d9b0-496b-af02-890aebc8ad03 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:46.658311 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-56f74874-d9b0-496b-af02-890aebc8ad03 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] HTTP exception thrown: Instance 5741fba7-f551-445e-833f-303eca2c8dae could not be found. Nov 19 03:29:46.658928 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-56f74874-d9b0-496b-af02-890aebc8ad03 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] Returning 404 to user: Instance 5741fba7-f551-445e-833f-303eca2c8dae could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:29:46.659740 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-56f74874-d9b0-496b-af02-890aebc8ad03 tempest-AttachVolumeTestJSON-655736952 tempest-AttachVolumeTestJSON-655736952-project] 10.222.0.47 "GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae" status: 404 len: 111 microversion: 2.1 time: 0.028516 Nov 19 03:29:46.660264 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 574/1230] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:46 2021] GET /compute/v2.1/servers/5741fba7-f551-445e-833f-303eca2c8dae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:29:51.226758 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-309bda01-feb8-4e22-814b-e412f0e24799 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:51.227676 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-309bda01-feb8-4e22-814b-e412f0e24799 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:51.234066 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-309bda01-feb8-4e22-814b-e412f0e24799 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:51.234542 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-309bda01-feb8-4e22-814b-e412f0e24799 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:51.236061 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-309bda01-feb8-4e22-814b-e412f0e24799 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:51.236627 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-309bda01-feb8-4e22-814b-e412f0e24799 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:51.266303 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-309bda01-feb8-4e22-814b-e412f0e24799 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043218 Nov 19 03:29:51.267363 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 657/1231] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Nov 19 03:29:51 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:29:51.324367 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f84f74a5-baf6-439c-a0a5-8bc575fd1b47 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:51.324924 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f84f74a5-baf6-439c-a0a5-8bc575fd1b47 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:51.331339 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f84f74a5-baf6-439c-a0a5-8bc575fd1b47 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:51.331783 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f84f74a5-baf6-439c-a0a5-8bc575fd1b47 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:51.332566 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f84f74a5-baf6-439c-a0a5-8bc575fd1b47 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:51.333000 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-f84f74a5-baf6-439c-a0a5-8bc575fd1b47 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:51.357908 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-f84f74a5-baf6-439c-a0a5-8bc575fd1b47 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Going to try to terminate instance {{(pid=116066) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:29:51.432618 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f84f74a5-baf6-439c-a0a5-8bc575fd1b47 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 204 len: 0 microversion: 2.20 time: 0.111563 Nov 19 03:29:51.432865 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 575/1232] 10.222.0.47 () {60 vars in 1279 bytes} [Fri Nov 19 03:29:51 2021] DELETE /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 03:29:51.441796 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9407ada8-a78f-48f2-ae48-51fe51dcb205 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:51.442397 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9407ada8-a78f-48f2-ae48-51fe51dcb205 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:51.448344 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9407ada8-a78f-48f2-ae48-51fe51dcb205 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:51.448797 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9407ada8-a78f-48f2-ae48-51fe51dcb205 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:51.449576 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9407ada8-a78f-48f2-ae48-51fe51dcb205 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:51.450013 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9407ada8-a78f-48f2-ae48-51fe51dcb205 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:51.583357 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9407ada8-a78f-48f2-ae48-51fe51dcb205 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:51.591619 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9407ada8-a78f-48f2-ae48-51fe51dcb205 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:51.593114 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9407ada8-a78f-48f2-ae48-51fe51dcb205 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:51.594831 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9407ada8-a78f-48f2-ae48-51fe51dcb205 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1723 microversion: 2.20 time: 0.156961 Nov 19 03:29:51.595399 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 658/1233] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:29:51 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:29:52.613524 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b971e9b9-80be-4ec6-bab7-fde19713e603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:52.614224 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b971e9b9-80be-4ec6-bab7-fde19713e603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:52.620316 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b971e9b9-80be-4ec6-bab7-fde19713e603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:52.620759 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b971e9b9-80be-4ec6-bab7-fde19713e603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:52.621610 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b971e9b9-80be-4ec6-bab7-fde19713e603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:52.622044 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b971e9b9-80be-4ec6-bab7-fde19713e603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:52.763973 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b971e9b9-80be-4ec6-bab7-fde19713e603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:52.772441 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b971e9b9-80be-4ec6-bab7-fde19713e603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:52.773975 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b971e9b9-80be-4ec6-bab7-fde19713e603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:52.775075 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b971e9b9-80be-4ec6-bab7-fde19713e603 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1723 microversion: 2.20 time: 0.165798 Nov 19 03:29:52.775631 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 576/1234] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:29:52 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:29:53.793122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-20d483f0-8ca2-4e48-91c9-87c005fa0fd8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:53.794333 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-20d483f0-8ca2-4e48-91c9-87c005fa0fd8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:53.801074 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-20d483f0-8ca2-4e48-91c9-87c005fa0fd8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:53.801758 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-20d483f0-8ca2-4e48-91c9-87c005fa0fd8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:53.802757 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-20d483f0-8ca2-4e48-91c9-87c005fa0fd8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:53.803358 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-20d483f0-8ca2-4e48-91c9-87c005fa0fd8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:53.869580 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-20d483f0-8ca2-4e48-91c9-87c005fa0fd8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:53.879091 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-20d483f0-8ca2-4e48-91c9-87c005fa0fd8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:53.880682 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-20d483f0-8ca2-4e48-91c9-87c005fa0fd8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7badb98be6a6455c804f8960482cdceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcaf6436c60844aaba3497db6db06391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:29:53.881851 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-20d483f0-8ca2-4e48-91c9-87c005fa0fd8 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 200 len: 1655 microversion: 2.20 time: 0.092612 Nov 19 03:29:53.882628 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 659/1235] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:29:53 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 1655 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 03:29:54.034451 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-14feee33-3ac3-4321-91a0-d9629d0a2a93 req-bfd8ebbd-2711-4d48-b7d3-22015ae66228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a889deb-2a02-4c52-8e3d-a666e5cbb1ba", "name": "network-vif-deleted", "tag": "7ed0f6c9-ba15-4c53-b55d-b5d4da5d47f5"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:29:54.036240 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:29:54.036240 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:29:54.046133 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-14feee33-3ac3-4321-91a0-d9629d0a2a93 req-bfd8ebbd-2711-4d48-b7d3-22015ae66228 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:54.046710 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-14feee33-3ac3-4321-91a0-d9629d0a2a93 req-bfd8ebbd-2711-4d48-b7d3-22015ae66228 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:54.079540 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-14feee33-3ac3-4321-91a0-d9629d0a2a93 req-bfd8ebbd-2711-4d48-b7d3-22015ae66228 service nova] Creating event network-vif-deleted:7ed0f6c9-ba15-4c53-b55d-b5d4da5d47f5 for instance 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba on hv-cinder-81803 Nov 19 03:29:54.085726 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-14feee33-3ac3-4321-91a0-d9629d0a2a93 req-bfd8ebbd-2711-4d48-b7d3-22015ae66228 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054944 Nov 19 03:29:54.086972 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 577/1236] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:29:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:29:54.900960 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f31e97c5-abe9-41dc-aea2-31a1adb769ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:54.901658 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f31e97c5-abe9-41dc-aea2-31a1adb769ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:54.909035 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f31e97c5-abe9-41dc-aea2-31a1adb769ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:54.909492 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f31e97c5-abe9-41dc-aea2-31a1adb769ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:54.910294 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f31e97c5-abe9-41dc-aea2-31a1adb769ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:54.910756 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f31e97c5-abe9-41dc-aea2-31a1adb769ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:54.925892 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-f31e97c5-abe9-41dc-aea2-31a1adb769ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] HTTP exception thrown: Instance 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba could not be found. Nov 19 03:29:54.926559 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f31e97c5-abe9-41dc-aea2-31a1adb769ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Returning 404 to user: Instance 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:29:54.927386 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f31e97c5-abe9-41dc-aea2-31a1adb769ec tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 404 len: 111 microversion: 2.20 time: 0.030150 Nov 19 03:29:54.927947 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 660/1237] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Nov 19 03:29:54 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 19 03:29:54.937502 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-93c3437c-7382-4db4-a3f4-80f049ca0e08 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '.version_select at 0x7f845a201040>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:54.956821 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-93c3437c-7382-4db4-a3f4-80f049ca0e08 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390058591" status: 204 len: 0 microversion: 2.20 time: 0.023283 Nov 19 03:29:54.957400 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 578/1238] 10.222.0.47 () {60 vars in 1261 bytes} [Fri Nov 19 03:29:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390058591 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 03:29:56.743914 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7c3ddfe0-1895-4c51-afca-32608b186713 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:56.744418 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7c3ddfe0-1895-4c51-afca-32608b186713 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:56.751536 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c3ddfe0-1895-4c51-afca-32608b186713 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:56.751976 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c3ddfe0-1895-4c51-afca-32608b186713 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:56.752742 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c3ddfe0-1895-4c51-afca-32608b186713 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:56.753167 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7c3ddfe0-1895-4c51-afca-32608b186713 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:56.766110 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-7c3ddfe0-1895-4c51-afca-32608b186713 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] HTTP exception thrown: Instance 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba could not be found. Nov 19 03:29:56.766790 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7c3ddfe0-1895-4c51-afca-32608b186713 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Returning 404 to user: Instance 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:29:56.767606 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7c3ddfe0-1895-4c51-afca-32608b186713 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 404 len: 111 microversion: 2.1 time: 0.027294 Nov 19 03:29:56.768113 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 661/1239] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:29:56 2021] DELETE /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:29:56.776201 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8e66533f-f964-44d0-b1e3-0cd516192b3e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:56.776924 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8e66533f-f964-44d0-b1e3-0cd516192b3e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:56.783520 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e66533f-f964-44d0-b1e3-0cd516192b3e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:56.783964 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e66533f-f964-44d0-b1e3-0cd516192b3e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:56.784735 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e66533f-f964-44d0-b1e3-0cd516192b3e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:56.785164 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8e66533f-f964-44d0-b1e3-0cd516192b3e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:56.799454 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-8e66533f-f964-44d0-b1e3-0cd516192b3e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] HTTP exception thrown: Instance 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba could not be found. Nov 19 03:29:56.800031 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8e66533f-f964-44d0-b1e3-0cd516192b3e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Returning 404 to user: Instance 6a889deb-2a02-4c52-8e3d-a666e5cbb1ba could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:29:56.800841 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8e66533f-f964-44d0-b1e3-0cd516192b3e tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba" status: 404 len: 111 microversion: 2.1 time: 0.028733 Nov 19 03:29:56.801382 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 579/1240] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:56 2021] GET /compute/v2.1/servers/6a889deb-2a02-4c52-8e3d-a666e5cbb1ba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:29:57.931645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-80592f9c-a62a-47a2-91e5-51b859af3f5b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:57.931645 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-80592f9c-a62a-47a2-91e5-51b859af3f5b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:57.935292 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-80592f9c-a62a-47a2-91e5-51b859af3f5b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:57.935738 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-80592f9c-a62a-47a2-91e5-51b859af3f5b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:57.936834 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-80592f9c-a62a-47a2-91e5-51b859af3f5b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:57.937448 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-80592f9c-a62a-47a2-91e5-51b859af3f5b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:57.951995 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-80592f9c-a62a-47a2-91e5-51b859af3f5b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] HTTP exception thrown: Instance 8641ae42-77ad-4054-8073-76018892c1d8 could not be found. Nov 19 03:29:57.952969 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-80592f9c-a62a-47a2-91e5-51b859af3f5b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Returning 404 to user: Instance 8641ae42-77ad-4054-8073-76018892c1d8 could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:29:57.953563 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-80592f9c-a62a-47a2-91e5-51b859af3f5b tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 404 len: 111 microversion: 2.1 time: 0.031826 Nov 19 03:29:57.954144 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 662/1241] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:29:57 2021] DELETE /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:29:57.962814 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9555fe37-419e-46d6-a195-8809005ddd04 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:29:57.964240 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9555fe37-419e-46d6-a195-8809005ddd04 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] [instance: 8641ae42-77ad-4054-8073-76018892c1d8] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:29:57.970947 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9555fe37-419e-46d6-a195-8809005ddd04 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:57.971394 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9555fe37-419e-46d6-a195-8809005ddd04 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:57.972340 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9555fe37-419e-46d6-a195-8809005ddd04 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:29:57.972769 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9555fe37-419e-46d6-a195-8809005ddd04 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:29:57.986895 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-9555fe37-419e-46d6-a195-8809005ddd04 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] HTTP exception thrown: Instance 8641ae42-77ad-4054-8073-76018892c1d8 could not be found. Nov 19 03:29:57.987532 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9555fe37-419e-46d6-a195-8809005ddd04 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] Returning 404 to user: Instance 8641ae42-77ad-4054-8073-76018892c1d8 could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:29:57.988329 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9555fe37-419e-46d6-a195-8809005ddd04 tempest-AttachVolumeShelveTestJSON-866420289 tempest-AttachVolumeShelveTestJSON-866420289-project] 10.222.0.47 "GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8" status: 404 len: 111 microversion: 2.1 time: 0.030033 Nov 19 03:29:57.988865 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 580/1242] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:29:57 2021] GET /compute/v2.1/servers/8641ae42-77ad-4054-8073-76018892c1d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 03:30:03.187022 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ca5fdd3f-e6ac-411c-897c-4995485a0220 tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] Action: 'create', calling method: .version_select at 0x7f8459f71dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1117231184", "metadata": {"Type": "work"}}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:30:03.671170 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ca5fdd3f-e6ac-411c-897c-4995485a0220 tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.712870 Nov 19 03:30:03.671787 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 663/1243] 10.222.0.47 () {60 vars in 1155 bytes} [Fri Nov 19 03:30:02 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 714 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 19 03:30:03.682826 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f33cc3fb-1a88-4817-b15e-52e8185fb039 tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] Calling method '.version_select at 0x7f845a201ca0>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:03.845343 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f33cc3fb-1a88-4817-b15e-52e8185fb039 tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/96eafb29-fcab-4410-9544-b89664dc4935" status: 200 len: 353 microversion: 2.1 time: 0.165890 Nov 19 03:30:03.845909 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 581/1244] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:30:03 2021] GET /compute/v2.1/os-volumes/96eafb29-fcab-4410-9544-b89664dc4935 => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:30:04.857317 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ebcd8614-0e69-4221-95c0-06678dd07554 tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] Calling method '.version_select at 0x7f845abb63a0>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:04.902460 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ebcd8614-0e69-4221-95c0-06678dd07554 tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/96eafb29-fcab-4410-9544-b89664dc4935" status: 200 len: 354 microversion: 2.1 time: 0.049221 Nov 19 03:30:04.903054 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 664/1245] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:30:04 2021] GET /compute/v2.1/os-volumes/96eafb29-fcab-4410-9544-b89664dc4935 => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:30:04.914695 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4bec4a0f-52e5-4849-9cda-a825ba42aff7 tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] Calling method '.version_select at 0x7f8459fb68b0>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:04.962691 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4bec4a0f-52e5-4849-9cda-a825ba42aff7 tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/96eafb29-fcab-4410-9544-b89664dc4935" status: 200 len: 354 microversion: 2.1 time: 0.052017 Nov 19 03:30:04.963451 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 582/1246] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:30:04 2021] GET /compute/v2.1/os-volumes/96eafb29-fcab-4410-9544-b89664dc4935 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:30:04.982310 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-6b3394da-5b2e-4932-bff2-f9e6fb1cec2e tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] Calling method '.version_select at 0x7f845a15ee50>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:05.045147 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-6b3394da-5b2e-4932-bff2-f9e6fb1cec2e tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/96eafb29-fcab-4410-9544-b89664dc4935" status: 202 len: 0 microversion: 2.1 time: 0.066199 Nov 19 03:30:05.045759 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 665/1247] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Nov 19 03:30:04 2021] DELETE /compute/v2.1/os-volumes/96eafb29-fcab-4410-9544-b89664dc4935 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:30:05.054487 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-19fc840b-cb5a-4a5d-8a83-491792bf2553 tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] Calling method '.version_select at 0x7f845a0bf310>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:05.104424 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-19fc840b-cb5a-4a5d-8a83-491792bf2553 tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/96eafb29-fcab-4410-9544-b89664dc4935" status: 200 len: 353 microversion: 2.1 time: 0.054006 Nov 19 03:30:05.105209 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 583/1248] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:30:05 2021] GET /compute/v2.1/os-volumes/96eafb29-fcab-4410-9544-b89664dc4935 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:30:06.117236 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-decfb1d2-5b9b-4a1c-b8fa-9f912799ebdc tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] Calling method '.version_select at 0x7f8459f71940>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:06.145806 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-decfb1d2-5b9b-4a1c-b8fa-9f912799ebdc tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] HTTP exception thrown: Volume 96eafb29-fcab-4410-9544-b89664dc4935 could not be found. Nov 19 03:30:06.146436 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-decfb1d2-5b9b-4a1c-b8fa-9f912799ebdc tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] Returning 404 to user: Volume 96eafb29-fcab-4410-9544-b89664dc4935 could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:30:06.147531 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-decfb1d2-5b9b-4a1c-b8fa-9f912799ebdc tempest-VolumesGetTestJSON-113472832 tempest-VolumesGetTestJSON-113472832-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/96eafb29-fcab-4410-9544-b89664dc4935" status: 404 len: 109 microversion: 2.1 time: 0.034229 Nov 19 03:30:06.148083 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 666/1249] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Nov 19 03:30:06 2021] GET /compute/v2.1/os-volumes/96eafb29-fcab-4410-9544-b89664dc4935 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 03:30:07.400719 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-685232035", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "networks": [{"uuid": "f7a7cecd-d962-4862-b1b4-9d2eba0e36dc"}]}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:30:07.459866 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.network.neutron [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] validate_networks() for [('f7a7cecd-d962-4862-b1b4-9d2eba0e36dc', None, None, None, None, None)] {{(pid=116066) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:30:07.842862 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Flavor limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:30:07.843284 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Image limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:30:07.845408 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Flavor pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:30:07.845831 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Image pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:30:07.846251 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:30:07.854919 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:07.855385 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:07.856434 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:07.856870 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:07.872680 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Getting quotas for project 91f91e4c836743529140b019cdb7b47b. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:30:07.876518 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Getting quotas for user 471f80b65c3d4f44a088616ec6d43e77 and project 91f91e4c836743529140b019cdb7b47b. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:30:07.886788 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Going to run 1 instances... {{(pid=116066) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:30:07.889081 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:30:07.936193 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0643101f-6f78-43aa-8ada-2b4be3e928b9 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539476 Nov 19 03:30:07.937141 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 584/1250] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:30:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:30:07.950132 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-30c56662-2c32-487f-8d20-87affb0b7f8e tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:07.955070 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-30c56662-2c32-487f-8d20-87affb0b7f8e tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:30:08.011801 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-30c56662-2c32-487f-8d20-87affb0b7f8e tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:30:08.019555 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-30c56662-2c32-487f-8d20-87affb0b7f8e tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 200 len: 1218 microversion: 2.1 time: 0.076282 Nov 19 03:30:08.022660 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 667/1251] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:30:07 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:30:09.037452 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-2e711df7-fa54-4098-a165-70c7ec0f746d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:09.038634 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-2e711df7-fa54-4098-a165-70c7ec0f746d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:30:09.046582 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2e711df7-fa54-4098-a165-70c7ec0f746d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:09.047104 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2e711df7-fa54-4098-a165-70c7ec0f746d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:09.048284 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2e711df7-fa54-4098-a165-70c7ec0f746d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:09.049192 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-2e711df7-fa54-4098-a165-70c7ec0f746d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:09.131029 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-2e711df7-fa54-4098-a165-70c7ec0f746d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:30:09.140999 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-2e711df7-fa54-4098-a165-70c7ec0f746d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 200 len: 1288 microversion: 2.1 time: 0.108150 Nov 19 03:30:09.142032 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 585/1252] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:30:09 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 1288 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:30:10.158770 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-728ffaad-ae8f-4424-a364-28a163bbb9b2 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:10.159465 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-728ffaad-ae8f-4424-a364-28a163bbb9b2 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:30:10.165886 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-728ffaad-ae8f-4424-a364-28a163bbb9b2 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:10.166331 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-728ffaad-ae8f-4424-a364-28a163bbb9b2 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:10.167133 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-728ffaad-ae8f-4424-a364-28a163bbb9b2 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:10.167824 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-728ffaad-ae8f-4424-a364-28a163bbb9b2 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:10.381479 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-02cba118-569c-4727-a90d-97a16b0c09d7 req-abfc742d-407e-40e5-8bd2-3fa1906691f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a24f3a83-3eac-49f6-91cf-e018bc867888", "tag": "9df85eaf-331b-4f2d-9fae-ba6ee80830f9"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:30:10.383777 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:30:10.383777 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:30:10.394124 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-02cba118-569c-4727-a90d-97a16b0c09d7 req-abfc742d-407e-40e5-8bd2-3fa1906691f9 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:10.394604 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-02cba118-569c-4727-a90d-97a16b0c09d7 req-abfc742d-407e-40e5-8bd2-3fa1906691f9 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:10.402082 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-728ffaad-ae8f-4424-a364-28a163bbb9b2 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:30:10.410329 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-728ffaad-ae8f-4424-a364-28a163bbb9b2 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 200 len: 1318 microversion: 2.1 time: 0.255726 Nov 19 03:30:10.421219 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 668/1253] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:30:10 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:30:10.421403 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-02cba118-569c-4727-a90d-97a16b0c09d7 req-abfc742d-407e-40e5-8bd2-3fa1906691f9 service nova] Creating event network-changed:9df85eaf-331b-4f2d-9fae-ba6ee80830f9 for instance a24f3a83-3eac-49f6-91cf-e018bc867888 on hv-cinder-81803 Nov 19 03:30:10.427451 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-02cba118-569c-4727-a90d-97a16b0c09d7 req-abfc742d-407e-40e5-8bd2-3fa1906691f9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050629 Nov 19 03:30:10.428053 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 586/1254] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:30:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:30:11.427387 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0abed591-f909-4ed7-8d73-ce932abea60e tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:11.427997 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0abed591-f909-4ed7-8d73-ce932abea60e tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:30:11.433867 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0abed591-f909-4ed7-8d73-ce932abea60e tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:11.434312 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0abed591-f909-4ed7-8d73-ce932abea60e tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:11.435107 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0abed591-f909-4ed7-8d73-ce932abea60e tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:11.435531 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-0abed591-f909-4ed7-8d73-ce932abea60e tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:11.610841 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0abed591-f909-4ed7-8d73-ce932abea60e tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:30:11.618586 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0abed591-f909-4ed7-8d73-ce932abea60e tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 200 len: 1318 microversion: 2.1 time: 0.194730 Nov 19 03:30:11.619151 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 669/1255] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:30:11 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:30:12.639257 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-09a40fa3-5866-4254-bc29-21ca8963089d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:12.639983 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-09a40fa3-5866-4254-bc29-21ca8963089d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:30:12.646924 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09a40fa3-5866-4254-bc29-21ca8963089d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:12.647373 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09a40fa3-5866-4254-bc29-21ca8963089d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:12.648334 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09a40fa3-5866-4254-bc29-21ca8963089d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:12.648773 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09a40fa3-5866-4254-bc29-21ca8963089d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:12.825730 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-09a40fa3-5866-4254-bc29-21ca8963089d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:30:12.834217 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-09a40fa3-5866-4254-bc29-21ca8963089d tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 200 len: 1318 microversion: 2.1 time: 0.202216 Nov 19 03:30:12.835004 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 587/1256] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:30:12 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:30:13.850862 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4e775b37-2346-4a5a-90d1-6b1863bdb9fe tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:13.851586 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4e775b37-2346-4a5a-90d1-6b1863bdb9fe tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:30:13.863113 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e775b37-2346-4a5a-90d1-6b1863bdb9fe tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:13.863902 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e775b37-2346-4a5a-90d1-6b1863bdb9fe tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:13.865013 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e775b37-2346-4a5a-90d1-6b1863bdb9fe tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:13.865565 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4e775b37-2346-4a5a-90d1-6b1863bdb9fe tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:14.007801 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4e775b37-2346-4a5a-90d1-6b1863bdb9fe tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:30:14.015232 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4e775b37-2346-4a5a-90d1-6b1863bdb9fe tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 200 len: 1318 microversion: 2.1 time: 0.168509 Nov 19 03:30:14.015872 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 670/1257] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:30:13 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:30:15.032232 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1fe2c23c-9bfd-481d-90e0-d9b30f922886 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:15.033403 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1fe2c23c-9bfd-481d-90e0-d9b30f922886 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:30:15.044030 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1fe2c23c-9bfd-481d-90e0-d9b30f922886 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:15.045714 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1fe2c23c-9bfd-481d-90e0-d9b30f922886 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:15.046532 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1fe2c23c-9bfd-481d-90e0-d9b30f922886 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:15.046971 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1fe2c23c-9bfd-481d-90e0-d9b30f922886 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:15.183894 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1fe2c23c-9bfd-481d-90e0-d9b30f922886 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:30:15.191366 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1fe2c23c-9bfd-481d-90e0-d9b30f922886 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 200 len: 1318 microversion: 2.1 time: 0.162693 Nov 19 03:30:15.191935 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 588/1258] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:30:15 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:30:16.208440 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3737b1e8-657c-4af3-bca6-68b34425d360 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:16.209052 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3737b1e8-657c-4af3-bca6-68b34425d360 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:30:16.215415 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3737b1e8-657c-4af3-bca6-68b34425d360 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:16.215865 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3737b1e8-657c-4af3-bca6-68b34425d360 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:16.216760 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3737b1e8-657c-4af3-bca6-68b34425d360 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:16.217195 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3737b1e8-657c-4af3-bca6-68b34425d360 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:16.364238 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3737b1e8-657c-4af3-bca6-68b34425d360 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:30:16.372120 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3737b1e8-657c-4af3-bca6-68b34425d360 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 200 len: 1318 microversion: 2.1 time: 0.167617 Nov 19 03:30:16.383382 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 671/1259] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:30:16 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:30:16.519004 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-b69b3de7-5f64-4975-b999-a600ac8c26ea req-d1864bf8-3d8f-43bf-bb4b-cb7fe54f84a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24f3a83-3eac-49f6-91cf-e018bc867888", "name": "network-vif-plugged", "status": "completed", "tag": "9df85eaf-331b-4f2d-9fae-ba6ee80830f9"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:30:16.520573 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:30:16.520573 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:30:16.528346 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-b69b3de7-5f64-4975-b999-a600ac8c26ea req-d1864bf8-3d8f-43bf-bb4b-cb7fe54f84a0 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:16.528609 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-b69b3de7-5f64-4975-b999-a600ac8c26ea req-d1864bf8-3d8f-43bf-bb4b-cb7fe54f84a0 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:16.540389 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-b69b3de7-5f64-4975-b999-a600ac8c26ea req-d1864bf8-3d8f-43bf-bb4b-cb7fe54f84a0 service nova] Creating event network-vif-plugged:9df85eaf-331b-4f2d-9fae-ba6ee80830f9 for instance a24f3a83-3eac-49f6-91cf-e018bc867888 on hv-cinder-81803 Nov 19 03:30:16.545685 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-b69b3de7-5f64-4975-b999-a600ac8c26ea req-d1864bf8-3d8f-43bf-bb4b-cb7fe54f84a0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031320 Nov 19 03:30:16.546281 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 589/1260] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:30:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:30:17.390034 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-68d28be5-4f43-4fe3-953c-3d2535b7d5f4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:17.390661 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-68d28be5-4f43-4fe3-953c-3d2535b7d5f4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:30:17.397932 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-68d28be5-4f43-4fe3-953c-3d2535b7d5f4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:17.398375 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-68d28be5-4f43-4fe3-953c-3d2535b7d5f4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:17.399453 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-68d28be5-4f43-4fe3-953c-3d2535b7d5f4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:17.399888 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-68d28be5-4f43-4fe3-953c-3d2535b7d5f4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:17.557281 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-68d28be5-4f43-4fe3-953c-3d2535b7d5f4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:30:17.565203 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-68d28be5-4f43-4fe3-953c-3d2535b7d5f4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 200 len: 1318 microversion: 2.1 time: 0.178950 Nov 19 03:30:17.565774 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 672/1261] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:30:17 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:30:18.583667 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a74437f1-122e-48e4-a72e-3ec3fc944927 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:30:18.584358 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a74437f1-122e-48e4-a72e-3ec3fc944927 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:30:18.590401 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a74437f1-122e-48e4-a72e-3ec3fc944927 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:18.590961 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a74437f1-122e-48e4-a72e-3ec3fc944927 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:18.591726 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a74437f1-122e-48e4-a72e-3ec3fc944927 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:30:18.592153 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a74437f1-122e-48e4-a72e-3ec3fc944927 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:30:18.734238 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a74437f1-122e-48e4-a72e-3ec3fc944927 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:30:18.742905 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a74437f1-122e-48e4-a72e-3ec3fc944927 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 200 len: 1506 microversion: 2.1 time: 0.165012 Nov 19 03:30:18.754082 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 590/1262] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:30:18 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:30:40.424062 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:30:40.424635 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: Fri Nov 19 03:30:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:31:04.166061 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f055cbba-d004-4d2c-8f18-0a408abf7ac4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4e576ff-fc1e-4eaa-a786-940655dc2c77", "device": "/dev/sdb"}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:31:04.167688 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f055cbba-d004-4d2c-8f18-0a408abf7ac4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:04.173915 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f055cbba-d004-4d2c-8f18-0a408abf7ac4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:04.174362 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f055cbba-d004-4d2c-8f18-0a408abf7ac4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:04.175172 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f055cbba-d004-4d2c-8f18-0a408abf7ac4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:04.175610 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f055cbba-d004-4d2c-8f18-0a408abf7ac4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:04.418642 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f055cbba-d004-4d2c-8f18-0a408abf7ac4 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "POST /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256519 Nov 19 03:31:04.419240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 673/1263] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:31:04 2021] POST /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:31:34.175370 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b250997e-b69f-47b5-9e18-167b53cc1661 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:34.175839 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b250997e-b69f-47b5-9e18-167b53cc1661 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:34.181615 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b250997e-b69f-47b5-9e18-167b53cc1661 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:34.182050 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b250997e-b69f-47b5-9e18-167b53cc1661 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:34.182837 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b250997e-b69f-47b5-9e18-167b53cc1661 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:34.183265 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b250997e-b69f-47b5-9e18-167b53cc1661 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:34.260815 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.objects.instance [None req-b250997e-b69f-47b5-9e18-167b53cc1661 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lazy-loading 'services' on Instance uuid a24f3a83-3eac-49f6-91cf-e018bc867888 {{(pid=116066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:31:34.331698 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b250997e-b69f-47b5-9e18-167b53cc1661 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888/os-volume_attachments/c4e576ff-fc1e-4eaa-a786-940655dc2c77" status: 202 len: 0 microversion: 2.1 time: 0.160677 Nov 19 03:31:34.332746 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 591/1264] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Nov 19 03:31:34 2021] DELETE /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888/os-volume_attachments/c4e576ff-fc1e-4eaa-a786-940655dc2c77 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:31:35.447222 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a2e9baca-7f72-4995-8df5-ec9b06ef0d5c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:35.447808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a2e9baca-7f72-4995-8df5-ec9b06ef0d5c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:35.454296 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a2e9baca-7f72-4995-8df5-ec9b06ef0d5c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:35.454777 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a2e9baca-7f72-4995-8df5-ec9b06ef0d5c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:35.455550 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a2e9baca-7f72-4995-8df5-ec9b06ef0d5c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:35.455987 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a2e9baca-7f72-4995-8df5-ec9b06ef0d5c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:35.481359 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a2e9baca-7f72-4995-8df5-ec9b06ef0d5c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Going to try to terminate instance {{(pid=116065) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:31:35.553872 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a2e9baca-7f72-4995-8df5-ec9b06ef0d5c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 204 len: 0 microversion: 2.1 time: 0.110636 Nov 19 03:31:35.554557 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 674/1265] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:31:35 2021] DELETE /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:31:35.564004 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7d2783a0-2e24-4158-9fb1-705db1cef4de tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:35.564788 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7d2783a0-2e24-4158-9fb1-705db1cef4de tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:35.571404 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7d2783a0-2e24-4158-9fb1-705db1cef4de tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:35.571851 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7d2783a0-2e24-4158-9fb1-705db1cef4de tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:35.572624 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7d2783a0-2e24-4158-9fb1-705db1cef4de tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:35.573055 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7d2783a0-2e24-4158-9fb1-705db1cef4de tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:35.703348 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-7d2783a0-2e24-4158-9fb1-705db1cef4de tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:31:35.710703 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7d2783a0-2e24-4158-9fb1-705db1cef4de tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 200 len: 1512 microversion: 2.1 time: 0.151303 Nov 19 03:31:35.711976 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 592/1266] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:31:35 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:31:36.729783 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4470088a-a13e-4c41-b7bb-bef45df8033f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:36.730521 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4470088a-a13e-4c41-b7bb-bef45df8033f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:36.736347 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4470088a-a13e-4c41-b7bb-bef45df8033f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:36.736789 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4470088a-a13e-4c41-b7bb-bef45df8033f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:36.737552 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4470088a-a13e-4c41-b7bb-bef45df8033f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:36.737983 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4470088a-a13e-4c41-b7bb-bef45df8033f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:36.869167 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4470088a-a13e-4c41-b7bb-bef45df8033f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:31:36.876328 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4470088a-a13e-4c41-b7bb-bef45df8033f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 200 len: 1512 microversion: 2.1 time: 0.151298 Nov 19 03:31:36.876883 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 675/1267] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:31:36 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:31:37.892943 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c46850ea-598f-4171-ab2a-4c2b7872ca35 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:37.894240 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c46850ea-598f-4171-ab2a-4c2b7872ca35 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:37.900576 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c46850ea-598f-4171-ab2a-4c2b7872ca35 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:37.901029 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c46850ea-598f-4171-ab2a-4c2b7872ca35 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:37.901817 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c46850ea-598f-4171-ab2a-4c2b7872ca35 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:37.902264 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c46850ea-598f-4171-ab2a-4c2b7872ca35 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:37.964871 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c46850ea-598f-4171-ab2a-4c2b7872ca35 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:31:37.972212 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c46850ea-598f-4171-ab2a-4c2b7872ca35 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 200 len: 1303 microversion: 2.1 time: 0.082856 Nov 19 03:31:37.973032 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 676/1268] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:31:37 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 1303 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:31:38.052298 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-c0ecb03b-3bca-4681-ab50-d6b66cb948d8 req-343357a4-55e2-4d42-8451-8cea88754d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24f3a83-3eac-49f6-91cf-e018bc867888", "name": "network-vif-deleted", "tag": "9df85eaf-331b-4f2d-9fae-ba6ee80830f9"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:31:38.053866 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:31:38.053866 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:31:38.060940 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-c0ecb03b-3bca-4681-ab50-d6b66cb948d8 req-343357a4-55e2-4d42-8451-8cea88754d8e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:38.061381 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-c0ecb03b-3bca-4681-ab50-d6b66cb948d8 req-343357a4-55e2-4d42-8451-8cea88754d8e service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:38.072517 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-c0ecb03b-3bca-4681-ab50-d6b66cb948d8 req-343357a4-55e2-4d42-8451-8cea88754d8e service nova] Creating event network-vif-deleted:9df85eaf-331b-4f2d-9fae-ba6ee80830f9 for instance a24f3a83-3eac-49f6-91cf-e018bc867888 on hv-cinder-81803 Nov 19 03:31:38.077206 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-c0ecb03b-3bca-4681-ab50-d6b66cb948d8 req-343357a4-55e2-4d42-8451-8cea88754d8e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216147 Nov 19 03:31:38.077813 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 593/1269] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:31:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:31:38.276138 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:31:38.276138 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: Fri Nov 19 03:31:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:31:38.989262 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ba4983a5-71da-4716-8b67-f2b3d68e4aca tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:38.989909 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-ba4983a5-71da-4716-8b67-f2b3d68e4aca tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: a24f3a83-3eac-49f6-91cf-e018bc867888] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:38.996346 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ba4983a5-71da-4716-8b67-f2b3d68e4aca tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:38.996797 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ba4983a5-71da-4716-8b67-f2b3d68e4aca tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:38.997574 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ba4983a5-71da-4716-8b67-f2b3d68e4aca tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:38.998008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-ba4983a5-71da-4716-8b67-f2b3d68e4aca tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:39.011099 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-ba4983a5-71da-4716-8b67-f2b3d68e4aca tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] HTTP exception thrown: Instance a24f3a83-3eac-49f6-91cf-e018bc867888 could not be found. Nov 19 03:31:39.011671 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-ba4983a5-71da-4716-8b67-f2b3d68e4aca tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Returning 404 to user: Instance a24f3a83-3eac-49f6-91cf-e018bc867888 could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:31:39.012483 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-ba4983a5-71da-4716-8b67-f2b3d68e4aca tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888" status: 404 len: 111 microversion: 2.1 time: 0.026945 Nov 19 03:31:39.012995 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 677/1270] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:31:38 2021] GET /compute/v2.1/servers/a24f3a83-3eac-49f6-91cf-e018bc867888 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:31:48.817355 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1774511452", "imageRef": "91be5742-0f84-40d3-9511-5b68de342164", "flavorRef": "452", "networks": [{"uuid": "f7a7cecd-d962-4862-b1b4-9d2eba0e36dc"}]}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:31:48.869180 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.network.neutron [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] validate_networks() for [('f7a7cecd-d962-4862-b1b4-9d2eba0e36dc', None, None, None, None, None)] {{(pid=116066) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:31:49.543851 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Flavor limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:31:49.544266 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Image limits 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:31:49.544726 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Flavor pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:31:49.545150 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Image pref 0:0:0 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:31:49.545557 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.virt.hardware [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:31:49.554274 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:49.554718 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:49.555527 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:49.555961 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:49.571798 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Getting quotas for project 91f91e4c836743529140b019cdb7b47b. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:31:49.575641 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Getting quotas for user 471f80b65c3d4f44a088616ec6d43e77 and project 91f91e4c836743529140b019cdb7b47b. Resources: {'cores', 'instances', 'ram'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:31:49.586661 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Going to run 1 instances... {{(pid=116066) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:31:49.588992 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91be5742-0f84-40d3-9511-5b68de342164',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:31:49.631062 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4cb3cc8d-b777-4749-a7d5-23d134643a9f tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817998 Nov 19 03:31:49.631634 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 594/1271] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:31:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:31:49.641461 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-0e7157e5-b161-499b-a7ef-d3af42c9b667 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:49.642075 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-0e7157e5-b161-499b-a7ef-d3af42c9b667 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:49.696356 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-0e7157e5-b161-499b-a7ef-d3af42c9b667 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:31:49.702804 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-0e7157e5-b161-499b-a7ef-d3af42c9b667 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 200 len: 1219 microversion: 2.1 time: 0.064896 Nov 19 03:31:49.703450 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 678/1272] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:31:49 2021] GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:31:50.722337 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-6ef10768-1ff1-4114-910a-3699d9daeffb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:50.723031 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-6ef10768-1ff1-4114-910a-3699d9daeffb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:50.730984 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ef10768-1ff1-4114-910a-3699d9daeffb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:50.731429 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ef10768-1ff1-4114-910a-3699d9daeffb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:50.732211 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ef10768-1ff1-4114-910a-3699d9daeffb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:50.732639 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-6ef10768-1ff1-4114-910a-3699d9daeffb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:50.809950 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-6ef10768-1ff1-4114-910a-3699d9daeffb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:31:50.817443 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-6ef10768-1ff1-4114-910a-3699d9daeffb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 200 len: 1279 microversion: 2.1 time: 0.100714 Nov 19 03:31:50.818205 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 595/1273] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:31:50 2021] GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 1279 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:31:51.834520 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4c088de7-4a36-485d-a79e-1fd8c44cf0a8 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:51.835155 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4c088de7-4a36-485d-a79e-1fd8c44cf0a8 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:51.842244 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4c088de7-4a36-485d-a79e-1fd8c44cf0a8 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:51.842728 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4c088de7-4a36-485d-a79e-1fd8c44cf0a8 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:51.844165 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4c088de7-4a36-485d-a79e-1fd8c44cf0a8 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:51.844612 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4c088de7-4a36-485d-a79e-1fd8c44cf0a8 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:52.043872 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4c088de7-4a36-485d-a79e-1fd8c44cf0a8 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:31:52.051567 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4c088de7-4a36-485d-a79e-1fd8c44cf0a8 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 200 len: 1319 microversion: 2.1 time: 0.220680 Nov 19 03:31:52.052098 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 679/1274] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:31:51 2021] GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:31:52.087746 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-e0f7aa67-afbe-4320-9f83-19b6d4fcabed req-3a12b770-79c7-4691-94d2-247b5bda4793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd963dc-ce54-46bd-8abf-52afa2be8088", "tag": "40f8aad2-6c57-45c5-80b3-57f59d293850"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:31:52.090121 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:31:52.090121 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:31:52.099007 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-e0f7aa67-afbe-4320-9f83-19b6d4fcabed req-3a12b770-79c7-4691-94d2-247b5bda4793 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:52.099475 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-e0f7aa67-afbe-4320-9f83-19b6d4fcabed req-3a12b770-79c7-4691-94d2-247b5bda4793 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:52.111788 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-e0f7aa67-afbe-4320-9f83-19b6d4fcabed req-3a12b770-79c7-4691-94d2-247b5bda4793 service nova] Creating event network-changed:40f8aad2-6c57-45c5-80b3-57f59d293850 for instance 3dd963dc-ce54-46bd-8abf-52afa2be8088 on hv-cinder-81803 Nov 19 03:31:52.117983 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-e0f7aa67-afbe-4320-9f83-19b6d4fcabed req-3a12b770-79c7-4691-94d2-247b5bda4793 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033958 Nov 19 03:31:52.118601 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 596/1275] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:31:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:31:53.069723 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-41d1995e-7058-4c98-92df-3d0701faf8fb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:53.071920 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-41d1995e-7058-4c98-92df-3d0701faf8fb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:53.078847 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-41d1995e-7058-4c98-92df-3d0701faf8fb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:53.079002 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-41d1995e-7058-4c98-92df-3d0701faf8fb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:53.079749 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-41d1995e-7058-4c98-92df-3d0701faf8fb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:53.080174 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-41d1995e-7058-4c98-92df-3d0701faf8fb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:53.232868 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-41d1995e-7058-4c98-92df-3d0701faf8fb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:31:53.241521 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-41d1995e-7058-4c98-92df-3d0701faf8fb tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 200 len: 1319 microversion: 2.1 time: 0.175509 Nov 19 03:31:53.242326 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 680/1276] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:31:53 2021] GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:31:54.259604 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1e56af2c-14cf-4345-b1fc-6204e20e821c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:54.260293 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1e56af2c-14cf-4345-b1fc-6204e20e821c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:54.266852 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1e56af2c-14cf-4345-b1fc-6204e20e821c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:54.267296 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1e56af2c-14cf-4345-b1fc-6204e20e821c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:54.268070 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1e56af2c-14cf-4345-b1fc-6204e20e821c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:54.268495 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1e56af2c-14cf-4345-b1fc-6204e20e821c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:54.400544 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1e56af2c-14cf-4345-b1fc-6204e20e821c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:31:54.407758 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1e56af2c-14cf-4345-b1fc-6204e20e821c tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 200 len: 1319 microversion: 2.1 time: 0.152909 Nov 19 03:31:54.408327 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 597/1277] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:31:54 2021] GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:31:55.424913 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-42b6f95e-cb1e-453f-beb1-9e83d02227cc tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:55.425476 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-42b6f95e-cb1e-453f-beb1-9e83d02227cc tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:55.431880 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-42b6f95e-cb1e-453f-beb1-9e83d02227cc tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:55.432321 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-42b6f95e-cb1e-453f-beb1-9e83d02227cc tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:55.433088 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-42b6f95e-cb1e-453f-beb1-9e83d02227cc tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:55.433516 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-42b6f95e-cb1e-453f-beb1-9e83d02227cc tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:55.567038 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-42b6f95e-cb1e-453f-beb1-9e83d02227cc tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:31:55.574985 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-42b6f95e-cb1e-453f-beb1-9e83d02227cc tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 200 len: 1319 microversion: 2.1 time: 0.153607 Nov 19 03:31:55.575554 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 681/1278] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:31:55 2021] GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:31:56.591626 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-8eac8a81-44c3-4c4b-8799-e74c4c653536 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:56.592235 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-8eac8a81-44c3-4c4b-8799-e74c4c653536 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:56.598635 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8eac8a81-44c3-4c4b-8799-e74c4c653536 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:56.599079 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8eac8a81-44c3-4c4b-8799-e74c4c653536 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:56.599848 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8eac8a81-44c3-4c4b-8799-e74c4c653536 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:56.600492 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-8eac8a81-44c3-4c4b-8799-e74c4c653536 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:56.733694 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-8eac8a81-44c3-4c4b-8799-e74c4c653536 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:31:56.741311 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-8eac8a81-44c3-4c4b-8799-e74c4c653536 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 200 len: 1319 microversion: 2.1 time: 0.153301 Nov 19 03:31:56.741899 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 598/1279] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:31:56 2021] GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:31:57.142172 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-072841fc-906f-40c2-a40b-6c8032e935fd req-1f7cb88e-a8ab-47c6-83d9-5e98a6f2630d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd963dc-ce54-46bd-8abf-52afa2be8088", "name": "network-vif-plugged", "status": "completed", "tag": "40f8aad2-6c57-45c5-80b3-57f59d293850"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:31:57.144016 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:31:57.144016 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:31:57.151616 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-072841fc-906f-40c2-a40b-6c8032e935fd req-1f7cb88e-a8ab-47c6-83d9-5e98a6f2630d service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:57.152061 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-072841fc-906f-40c2-a40b-6c8032e935fd req-1f7cb88e-a8ab-47c6-83d9-5e98a6f2630d service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:57.163457 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-072841fc-906f-40c2-a40b-6c8032e935fd req-1f7cb88e-a8ab-47c6-83d9-5e98a6f2630d service nova] Creating event network-vif-plugged:40f8aad2-6c57-45c5-80b3-57f59d293850 for instance 3dd963dc-ce54-46bd-8abf-52afa2be8088 on hv-cinder-81803 Nov 19 03:31:57.168655 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-072841fc-906f-40c2-a40b-6c8032e935fd req-1f7cb88e-a8ab-47c6-83d9-5e98a6f2630d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090015 Nov 19 03:31:57.169225 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 682/1280] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:31:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:31:57.758862 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-86a993d7-e7c9-48f8-b6ec-dff92c545e2b tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:57.759460 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-86a993d7-e7c9-48f8-b6ec-dff92c545e2b tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:57.765690 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-86a993d7-e7c9-48f8-b6ec-dff92c545e2b tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:57.766132 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-86a993d7-e7c9-48f8-b6ec-dff92c545e2b tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:57.766935 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-86a993d7-e7c9-48f8-b6ec-dff92c545e2b tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:57.767364 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-86a993d7-e7c9-48f8-b6ec-dff92c545e2b tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:58.037381 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-86a993d7-e7c9-48f8-b6ec-dff92c545e2b tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:31:58.044932 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-86a993d7-e7c9-48f8-b6ec-dff92c545e2b tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 200 len: 1319 microversion: 2.1 time: 0.290476 Nov 19 03:31:58.045500 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 599/1281] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:31:57 2021] GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:31:59.062597 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c26b89d1-240d-46f6-8c9e-6957fbf85932 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:31:59.063287 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c26b89d1-240d-46f6-8c9e-6957fbf85932 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:59.070361 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c26b89d1-240d-46f6-8c9e-6957fbf85932 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:59.070776 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c26b89d1-240d-46f6-8c9e-6957fbf85932 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:59.071567 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c26b89d1-240d-46f6-8c9e-6957fbf85932 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:59.071992 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c26b89d1-240d-46f6-8c9e-6957fbf85932 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:59.210770 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c26b89d1-240d-46f6-8c9e-6957fbf85932 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:31:59.217909 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c26b89d1-240d-46f6-8c9e-6957fbf85932 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 200 len: 1507 microversion: 2.1 time: 0.159840 Nov 19 03:31:59.218489 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 683/1282] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:31:59 2021] GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:31:59.233890 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5c4989ba-90fd-4fb8-90e0-423bd870b908 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "352de0ca-f6f0-432f-8259-7ab4675443ec", "device": "/dev/sdb"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:31:59.235494 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5c4989ba-90fd-4fb8-90e0-423bd870b908 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:31:59.242919 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5c4989ba-90fd-4fb8-90e0-423bd870b908 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:59.243366 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5c4989ba-90fd-4fb8-90e0-423bd870b908 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:59.244144 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5c4989ba-90fd-4fb8-90e0-423bd870b908 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:31:59.244578 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5c4989ba-90fd-4fb8-90e0-423bd870b908 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:31:59.480375 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5c4989ba-90fd-4fb8-90e0-423bd870b908 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "POST /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250042 Nov 19 03:31:59.481046 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 600/1283] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Nov 19 03:31:59 2021] POST /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:32:26.123283 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-417371856", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-884116023", "security_groups": [{"name": "tempest-secgroup-smoke-1741082130"}], "block_device_mapping_v2": [{"uuid": "e7808612-8500-495e-8a45-6c973951274b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ec6214ac-d99f-413c-a1b4-78005c417695"}]}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:32:26.239110 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.network.neutron [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] validate_networks() for [('ec6214ac-d99f-413c-a1b4-78005c417695', None, None, None, None, None)] {{(pid=116065) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:32:26.660730 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Flavor limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:32:26.661154 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Image limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:32:26.661627 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Flavor pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:32:26.662040 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Image pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:32:26.662452 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:32:26.674358 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:26.674897 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:26.675728 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:26.676153 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:26.692281 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Getting quotas for project 0b123731cbb4468b8bae663587e792e7. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:32:26.696359 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Getting quotas for user 46cac61c2b3543fb8be6fbab87677bb2 and project 0b123731cbb4468b8bae663587e792e7. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:32:26.754841 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Going to run 1 instances... {{(pid=116065) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:32:26.756963 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7808612-8500-495e-8a45-6c973951274b',volume_size=None,volume_type=None)] {{(pid=116065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:32:26.888913 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d1baef92-4528-4c4f-a2a0-5bcf773a3d72 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.769207 Nov 19 03:32:26.889607 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 684/1284] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:32:26 2021] POST /compute/v2.1/servers => generated 406 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:32:26.900197 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-cd59fdae-96f6-4e7a-94f1-afd41b89b130 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:26.900891 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-cd59fdae-96f6-4e7a-94f1-afd41b89b130 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:26.954197 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-cd59fdae-96f6-4e7a-94f1-afd41b89b130 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:26.961933 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-cd59fdae-96f6-4e7a-94f1-afd41b89b130 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1093 microversion: 2.1 time: 0.066033 Nov 19 03:32:26.962606 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 601/1285] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:26 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:27.979367 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2b841aa9-fb03-4e04-9ccb-bfa232a9b936 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:27.980089 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2b841aa9-fb03-4e04-9ccb-bfa232a9b936 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:27.986641 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2b841aa9-fb03-4e04-9ccb-bfa232a9b936 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:27.987362 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2b841aa9-fb03-4e04-9ccb-bfa232a9b936 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:27.988270 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2b841aa9-fb03-4e04-9ccb-bfa232a9b936 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:27.988761 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2b841aa9-fb03-4e04-9ccb-bfa232a9b936 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:28.062782 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2b841aa9-fb03-4e04-9ccb-bfa232a9b936 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:28.072935 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2b841aa9-fb03-4e04-9ccb-bfa232a9b936 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1209 microversion: 2.1 time: 0.098562 Nov 19 03:32:28.074069 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 685/1286] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:27 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:28.941526 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ba29aae6-9077-4ee5-80da-b963cf1b4483 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:28.942059 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ba29aae6-9077-4ee5-80da-b963cf1b4483 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:28.949645 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ba29aae6-9077-4ee5-80da-b963cf1b4483 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:28.950090 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ba29aae6-9077-4ee5-80da-b963cf1b4483 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:28.950882 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ba29aae6-9077-4ee5-80da-b963cf1b4483 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:28.951308 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ba29aae6-9077-4ee5-80da-b963cf1b4483 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:29.030185 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.objects.instance [None req-ba29aae6-9077-4ee5-80da-b963cf1b4483 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lazy-loading 'services' on Instance uuid 3dd963dc-ce54-46bd-8abf-52afa2be8088 {{(pid=116066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:32:29.093622 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-7b8f64f6-287c-47fb-b30b-d5d82353369d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:29.094611 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-7b8f64f6-287c-47fb-b30b-d5d82353369d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:29.106526 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ba29aae6-9077-4ee5-80da-b963cf1b4483 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088/os-volume_attachments/352de0ca-f6f0-432f-8259-7ab4675443ec" status: 202 len: 0 microversion: 2.1 time: 0.168393 Nov 19 03:32:29.107747 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 602/1287] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Nov 19 03:32:28 2021] DELETE /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088/os-volume_attachments/352de0ca-f6f0-432f-8259-7ab4675443ec => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:32:29.129084 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7b8f64f6-287c-47fb-b30b-d5d82353369d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:29.129807 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7b8f64f6-287c-47fb-b30b-d5d82353369d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:29.131102 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7b8f64f6-287c-47fb-b30b-d5d82353369d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:29.133807 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-7b8f64f6-287c-47fb-b30b-d5d82353369d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:29.356666 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-7b8f64f6-287c-47fb-b30b-d5d82353369d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:29.364068 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-7b8f64f6-287c-47fb-b30b-d5d82353369d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.276125 Nov 19 03:32:29.364638 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 686/1288] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:29 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:29.404154 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-28783161-d724-4cf9-9e86-25a1fe034321 req-15930f64-0cd9-4e6d-a1e5-499081447776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5253f7-3260-4ac4-9d04-0233ef59dc45", "tag": "cbb52976-7d32-47e8-a00a-a0efa3d3f95a"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:32:29.405864 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:32:29.405864 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:32:29.414974 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-28783161-d724-4cf9-9e86-25a1fe034321 req-15930f64-0cd9-4e6d-a1e5-499081447776 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:29.415851 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-28783161-d724-4cf9-9e86-25a1fe034321 req-15930f64-0cd9-4e6d-a1e5-499081447776 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:29.435682 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-28783161-d724-4cf9-9e86-25a1fe034321 req-15930f64-0cd9-4e6d-a1e5-499081447776 service nova] Creating event network-changed:cbb52976-7d32-47e8-a00a-a0efa3d3f95a for instance 6e5253f7-3260-4ac4-9d04-0233ef59dc45 on hv-cinder-81803 Nov 19 03:32:29.440203 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-28783161-d724-4cf9-9e86-25a1fe034321 req-15930f64-0cd9-4e6d-a1e5-499081447776 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040477 Nov 19 03:32:29.441069 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 603/1289] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:32:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:32:30.229747 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-95daaea8-717a-4eeb-82ed-5f7e7aa07ddd tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:30.230754 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-95daaea8-717a-4eeb-82ed-5f7e7aa07ddd tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:30.237032 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-95daaea8-717a-4eeb-82ed-5f7e7aa07ddd tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:30.237483 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-95daaea8-717a-4eeb-82ed-5f7e7aa07ddd tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:30.238266 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-95daaea8-717a-4eeb-82ed-5f7e7aa07ddd tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:30.238727 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-95daaea8-717a-4eeb-82ed-5f7e7aa07ddd tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:30.263809 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-95daaea8-717a-4eeb-82ed-5f7e7aa07ddd tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Going to try to terminate instance {{(pid=116065) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:32:30.341278 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-95daaea8-717a-4eeb-82ed-5f7e7aa07ddd tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 204 len: 0 microversion: 2.1 time: 0.114808 Nov 19 03:32:30.342208 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 687/1290] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:32:30 2021] DELETE /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:32:30.352157 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e0a81c1f-b592-4282-aa51-8fc4d0b0b5b6 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:30.353078 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e0a81c1f-b592-4282-aa51-8fc4d0b0b5b6 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:30.359297 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e0a81c1f-b592-4282-aa51-8fc4d0b0b5b6 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:30.359820 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e0a81c1f-b592-4282-aa51-8fc4d0b0b5b6 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:30.360668 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e0a81c1f-b592-4282-aa51-8fc4d0b0b5b6 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:30.361105 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e0a81c1f-b592-4282-aa51-8fc4d0b0b5b6 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:30.382539 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-96849631-1c4f-45f2-822a-d33786a27c6d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:30.383453 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-96849631-1c4f-45f2-822a-d33786a27c6d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:30.389533 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-96849631-1c4f-45f2-822a-d33786a27c6d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:30.390103 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-96849631-1c4f-45f2-822a-d33786a27c6d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:30.391054 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-96849631-1c4f-45f2-822a-d33786a27c6d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:30.391475 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-96849631-1c4f-45f2-822a-d33786a27c6d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:30.885152 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-e0a81c1f-b592-4282-aa51-8fc4d0b0b5b6 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:30.894142 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e0a81c1f-b592-4282-aa51-8fc4d0b0b5b6 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 200 len: 1513 microversion: 2.1 time: 0.546882 Nov 19 03:32:30.894760 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 604/1291] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:30 2021] GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 1513 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:30.910205 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-96849631-1c4f-45f2-822a-d33786a27c6d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:30.918461 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-96849631-1c4f-45f2-822a-d33786a27c6d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.540700 Nov 19 03:32:30.919064 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 688/1292] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:30 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:32:31.910369 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5432a749-de17-4310-977c-9dd7af1684d5 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:31.910999 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5432a749-de17-4310-977c-9dd7af1684d5 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:31.917643 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5432a749-de17-4310-977c-9dd7af1684d5 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:31.918096 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5432a749-de17-4310-977c-9dd7af1684d5 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:31.918914 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5432a749-de17-4310-977c-9dd7af1684d5 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:31.919347 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5432a749-de17-4310-977c-9dd7af1684d5 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:31.934953 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-49a12373-1d3c-47a1-82ae-0b02a9c0044d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:31.935562 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-49a12373-1d3c-47a1-82ae-0b02a9c0044d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:31.941671 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-49a12373-1d3c-47a1-82ae-0b02a9c0044d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:31.942121 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-49a12373-1d3c-47a1-82ae-0b02a9c0044d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:31.942920 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-49a12373-1d3c-47a1-82ae-0b02a9c0044d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:31.943357 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-49a12373-1d3c-47a1-82ae-0b02a9c0044d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:32.117744 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5432a749-de17-4310-977c-9dd7af1684d5 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:32.125044 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5432a749-de17-4310-977c-9dd7af1684d5 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 200 len: 1513 microversion: 2.1 time: 0.218369 Nov 19 03:32:32.125615 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 605/1293] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:31 2021] GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:32.126537 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-49a12373-1d3c-47a1-82ae-0b02a9c0044d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:32.134449 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-49a12373-1d3c-47a1-82ae-0b02a9c0044d tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.203111 Nov 19 03:32:32.135064 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 689/1294] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:31 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:32:33.142352 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-09381288-61ce-415d-b8c9-e54f7ba12b20 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:33.142985 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-09381288-61ce-415d-b8c9-e54f7ba12b20 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:33.150429 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09381288-61ce-415d-b8c9-e54f7ba12b20 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:33.150901 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09381288-61ce-415d-b8c9-e54f7ba12b20 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:33.151069 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-62f8cea8-5bf4-4fc3-babe-6a0005f928f2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:33.151614 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-62f8cea8-5bf4-4fc3-babe-6a0005f928f2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:33.151724 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09381288-61ce-415d-b8c9-e54f7ba12b20 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:33.152088 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-09381288-61ce-415d-b8c9-e54f7ba12b20 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:33.157738 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-62f8cea8-5bf4-4fc3-babe-6a0005f928f2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:33.158189 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-62f8cea8-5bf4-4fc3-babe-6a0005f928f2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:33.158984 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-62f8cea8-5bf4-4fc3-babe-6a0005f928f2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:33.159417 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-62f8cea8-5bf4-4fc3-babe-6a0005f928f2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:33.354828 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-09381288-61ce-415d-b8c9-e54f7ba12b20 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471f80b65c3d4f44a088616ec6d43e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f91e4c836743529140b019cdb7b47b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:33.362057 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-09381288-61ce-415d-b8c9-e54f7ba12b20 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 200 len: 1513 microversion: 2.1 time: 0.223329 Nov 19 03:32:33.362655 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 606/1295] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:33 2021] GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:33.371061 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-62f8cea8-5bf4-4fc3-babe-6a0005f928f2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:33.378280 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-62f8cea8-5bf4-4fc3-babe-6a0005f928f2 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.231489 Nov 19 03:32:33.378892 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 690/1296] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:33 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:32:33.795138 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-db891f9c-3c87-4321-8a0c-126579c4ccf8 req-d739f8f1-71fd-4dae-9306-c4d6175a5a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd963dc-ce54-46bd-8abf-52afa2be8088", "name": "network-vif-deleted", "tag": "40f8aad2-6c57-45c5-80b3-57f59d293850"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:32:33.796699 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:32:33.796699 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:32:33.803781 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-db891f9c-3c87-4321-8a0c-126579c4ccf8 req-d739f8f1-71fd-4dae-9306-c4d6175a5a5d service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:33.804220 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-db891f9c-3c87-4321-8a0c-126579c4ccf8 req-d739f8f1-71fd-4dae-9306-c4d6175a5a5d service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:33.814962 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-db891f9c-3c87-4321-8a0c-126579c4ccf8 req-d739f8f1-71fd-4dae-9306-c4d6175a5a5d service nova] Creating event network-vif-deleted:40f8aad2-6c57-45c5-80b3-57f59d293850 for instance 3dd963dc-ce54-46bd-8abf-52afa2be8088 on hv-cinder-81803 Nov 19 03:32:33.820488 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-db891f9c-3c87-4321-8a0c-126579c4ccf8 req-d739f8f1-71fd-4dae-9306-c4d6175a5a5d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029182 Nov 19 03:32:33.821066 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 607/1297] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:32:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:32:34.380076 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c6056051-754e-48dd-a17b-a4e903b83133 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:34.380628 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c6056051-754e-48dd-a17b-a4e903b83133 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] [instance: 3dd963dc-ce54-46bd-8abf-52afa2be8088] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:34.386809 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c6056051-754e-48dd-a17b-a4e903b83133 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:34.387251 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c6056051-754e-48dd-a17b-a4e903b83133 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:34.388009 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c6056051-754e-48dd-a17b-a4e903b83133 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:34.388437 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c6056051-754e-48dd-a17b-a4e903b83133 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:34.395682 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5182a7de-d0cb-42c3-9562-eec1132b3cf9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:34.396369 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5182a7de-d0cb-42c3-9562-eec1132b3cf9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:34.402294 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-c6056051-754e-48dd-a17b-a4e903b83133 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] HTTP exception thrown: Instance 3dd963dc-ce54-46bd-8abf-52afa2be8088 could not be found. Nov 19 03:32:34.402906 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c6056051-754e-48dd-a17b-a4e903b83133 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] Returning 404 to user: Instance 3dd963dc-ce54-46bd-8abf-52afa2be8088 could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:32:34.403489 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5182a7de-d0cb-42c3-9562-eec1132b3cf9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:34.403716 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c6056051-754e-48dd-a17b-a4e903b83133 tempest-VolumesSnapshotTestJSON-425028906 tempest-VolumesSnapshotTestJSON-425028906-project] 10.222.0.47 "GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088" status: 404 len: 111 microversion: 2.1 time: 0.027527 Nov 19 03:32:34.403986 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5182a7de-d0cb-42c3-9562-eec1132b3cf9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:34.404256 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 691/1298] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:34 2021] GET /compute/v2.1/servers/3dd963dc-ce54-46bd-8abf-52afa2be8088 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:32:34.404684 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5182a7de-d0cb-42c3-9562-eec1132b3cf9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:34.405110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5182a7de-d0cb-42c3-9562-eec1132b3cf9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:34.546501 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-5182a7de-d0cb-42c3-9562-eec1132b3cf9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:34.554408 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5182a7de-d0cb-42c3-9562-eec1132b3cf9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.163085 Nov 19 03:32:34.555004 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 608/1299] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:34 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:35.571180 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b93cd75a-d8a6-4122-9080-8a7613893caf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:35.571788 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b93cd75a-d8a6-4122-9080-8a7613893caf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:35.577976 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b93cd75a-d8a6-4122-9080-8a7613893caf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:35.578414 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b93cd75a-d8a6-4122-9080-8a7613893caf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:35.579207 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b93cd75a-d8a6-4122-9080-8a7613893caf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:35.579638 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b93cd75a-d8a6-4122-9080-8a7613893caf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:35.712413 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b93cd75a-d8a6-4122-9080-8a7613893caf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:35.719702 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b93cd75a-d8a6-4122-9080-8a7613893caf tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.152327 Nov 19 03:32:35.720256 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 692/1300] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:35 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:36.736925 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-69fd48ed-b9e4-43fc-856d-93c1456c754c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:36.737513 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-69fd48ed-b9e4-43fc-856d-93c1456c754c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:36.744453 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-69fd48ed-b9e4-43fc-856d-93c1456c754c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:36.744901 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-69fd48ed-b9e4-43fc-856d-93c1456c754c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:36.745669 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-69fd48ed-b9e4-43fc-856d-93c1456c754c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:36.746103 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-69fd48ed-b9e4-43fc-856d-93c1456c754c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:36.878237 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-69fd48ed-b9e4-43fc-856d-93c1456c754c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:36.889253 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-69fd48ed-b9e4-43fc-856d-93c1456c754c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.155880 Nov 19 03:32:36.889829 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 609/1301] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:36 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:37.906881 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-9a543b6a-693d-4589-aac3-177eac7cfcf3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:37.907473 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-9a543b6a-693d-4589-aac3-177eac7cfcf3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:37.913700 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a543b6a-693d-4589-aac3-177eac7cfcf3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:37.914152 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a543b6a-693d-4589-aac3-177eac7cfcf3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:37.914968 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a543b6a-693d-4589-aac3-177eac7cfcf3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:37.915409 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-9a543b6a-693d-4589-aac3-177eac7cfcf3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:38.044715 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-9a543b6a-693d-4589-aac3-177eac7cfcf3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:38.051939 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-9a543b6a-693d-4589-aac3-177eac7cfcf3 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.148976 Nov 19 03:32:38.052504 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 693/1302] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:37 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:39.069240 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-42e44446-502c-4af3-9011-eb8fefebb5d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:39.069865 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-42e44446-502c-4af3-9011-eb8fefebb5d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:39.076275 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-42e44446-502c-4af3-9011-eb8fefebb5d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:39.076726 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-42e44446-502c-4af3-9011-eb8fefebb5d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:39.077492 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-42e44446-502c-4af3-9011-eb8fefebb5d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:39.077914 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-42e44446-502c-4af3-9011-eb8fefebb5d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:39.211654 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-42e44446-502c-4af3-9011-eb8fefebb5d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:39.218781 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-42e44446-502c-4af3-9011-eb8fefebb5d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.153611 Nov 19 03:32:39.219338 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 610/1303] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:39 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:40.235306 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b31e3e7d-cc25-4be7-a221-bcf2515953d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:40.235850 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b31e3e7d-cc25-4be7-a221-bcf2515953d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:40.242851 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b31e3e7d-cc25-4be7-a221-bcf2515953d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:40.243286 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b31e3e7d-cc25-4be7-a221-bcf2515953d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:40.244066 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b31e3e7d-cc25-4be7-a221-bcf2515953d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:40.244513 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b31e3e7d-cc25-4be7-a221-bcf2515953d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:40.373350 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b31e3e7d-cc25-4be7-a221-bcf2515953d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:40.380554 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b31e3e7d-cc25-4be7-a221-bcf2515953d6 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.148987 Nov 19 03:32:40.381703 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 694/1304] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:40 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:41.397629 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-53797fb0-9832-4113-8ade-4f01e4ffbd68 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:41.398021 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-53797fb0-9832-4113-8ade-4f01e4ffbd68 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:41.404294 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-53797fb0-9832-4113-8ade-4f01e4ffbd68 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:41.404754 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-53797fb0-9832-4113-8ade-4f01e4ffbd68 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:41.405571 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-53797fb0-9832-4113-8ade-4f01e4ffbd68 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:41.406026 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-53797fb0-9832-4113-8ade-4f01e4ffbd68 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:41.537001 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-53797fb0-9832-4113-8ade-4f01e4ffbd68 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:41.545015 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-53797fb0-9832-4113-8ade-4f01e4ffbd68 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.151743 Nov 19 03:32:41.545572 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 611/1305] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:41 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:42.562406 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f3bc81e1-d244-4416-8419-66ced1ac6008 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:42.563031 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f3bc81e1-d244-4416-8419-66ced1ac6008 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:42.569877 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3bc81e1-d244-4416-8419-66ced1ac6008 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:42.570312 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3bc81e1-d244-4416-8419-66ced1ac6008 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:42.571108 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3bc81e1-d244-4416-8419-66ced1ac6008 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:42.571543 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f3bc81e1-d244-4416-8419-66ced1ac6008 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:42.709755 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f3bc81e1-d244-4416-8419-66ced1ac6008 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:42.717032 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f3bc81e1-d244-4416-8419-66ced1ac6008 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.158276 Nov 19 03:32:42.717595 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 695/1306] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:42 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:43.313702 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-c76f7a86-0f8b-4f61-a099-01421c024f83 req-0d44b939-2fae-455e-9891-d65eecd72bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5253f7-3260-4ac4-9d04-0233ef59dc45", "name": "network-vif-plugged", "status": "completed", "tag": "cbb52976-7d32-47e8-a00a-a0efa3d3f95a"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:32:43.315236 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:32:43.315236 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:32:43.323197 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-c76f7a86-0f8b-4f61-a099-01421c024f83 req-0d44b939-2fae-455e-9891-d65eecd72bce service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:43.323678 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-c76f7a86-0f8b-4f61-a099-01421c024f83 req-0d44b939-2fae-455e-9891-d65eecd72bce service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:43.335012 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-c76f7a86-0f8b-4f61-a099-01421c024f83 req-0d44b939-2fae-455e-9891-d65eecd72bce service nova] Creating event network-vif-plugged:cbb52976-7d32-47e8-a00a-a0efa3d3f95a for instance 6e5253f7-3260-4ac4-9d04-0233ef59dc45 on hv-cinder-81803 Nov 19 03:32:43.339908 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-c76f7a86-0f8b-4f61-a099-01421c024f83 req-0d44b939-2fae-455e-9891-d65eecd72bce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029895 Nov 19 03:32:43.340581 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 612/1307] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:32:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:32:43.736356 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2298c52e-006a-45f0-90b4-cb556c442beb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:43.736982 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2298c52e-006a-45f0-90b4-cb556c442beb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:43.744104 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2298c52e-006a-45f0-90b4-cb556c442beb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:43.744560 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2298c52e-006a-45f0-90b4-cb556c442beb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:43.745385 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2298c52e-006a-45f0-90b4-cb556c442beb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:43.746284 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2298c52e-006a-45f0-90b4-cb556c442beb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:43.883172 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2298c52e-006a-45f0-90b4-cb556c442beb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:43.890390 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2298c52e-006a-45f0-90b4-cb556c442beb tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.159074 Nov 19 03:32:43.890977 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 696/1308] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:43 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:44.909349 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c3732b82-2aab-4e9f-b8f5-7c7b2437c238 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:44.910143 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c3732b82-2aab-4e9f-b8f5-7c7b2437c238 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:44.918164 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c3732b82-2aab-4e9f-b8f5-7c7b2437c238 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:44.918652 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c3732b82-2aab-4e9f-b8f5-7c7b2437c238 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:44.919432 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c3732b82-2aab-4e9f-b8f5-7c7b2437c238 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:44.919856 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c3732b82-2aab-4e9f-b8f5-7c7b2437c238 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:45.063263 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c3732b82-2aab-4e9f-b8f5-7c7b2437c238 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:45.070890 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c3732b82-2aab-4e9f-b8f5-7c7b2437c238 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1265 microversion: 2.1 time: 0.166154 Nov 19 03:32:45.071772 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 613/1309] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:44 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:32:46.087170 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-4dc2ee48-27d9-46bd-acc9-0017912830f7 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:46.087783 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-4dc2ee48-27d9-46bd-acc9-0017912830f7 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:46.093968 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4dc2ee48-27d9-46bd-acc9-0017912830f7 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:46.094410 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4dc2ee48-27d9-46bd-acc9-0017912830f7 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:46.095229 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4dc2ee48-27d9-46bd-acc9-0017912830f7 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:46.095659 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-4dc2ee48-27d9-46bd-acc9-0017912830f7 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:46.229303 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-4dc2ee48-27d9-46bd-acc9-0017912830f7 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:46.236593 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-4dc2ee48-27d9-46bd-acc9-0017912830f7 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1452 microversion: 2.1 time: 0.153827 Nov 19 03:32:46.237151 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 697/1310] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:46 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:46.252186 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c024e730-c5e2-479f-b86e-15e07bed15a5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:32:46.252796 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c024e730-c5e2-479f-b86e-15e07bed15a5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:32:46.259220 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c024e730-c5e2-479f-b86e-15e07bed15a5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:46.259673 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c024e730-c5e2-479f-b86e-15e07bed15a5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:46.260447 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c024e730-c5e2-479f-b86e-15e07bed15a5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:46.260883 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c024e730-c5e2-479f-b86e-15e07bed15a5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:46.396730 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c024e730-c5e2-479f-b86e-15e07bed15a5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:32:46.404083 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c024e730-c5e2-479f-b86e-15e07bed15a5 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1452 microversion: 2.1 time: 0.155514 Nov 19 03:32:46.404651 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 614/1311] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:32:46 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:32:48.106350 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-28fb6f09-fc86-439b-990d-2619e35d1760 req-a42a6b9d-d65f-42fb-ae48-b043ff470bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5253f7-3260-4ac4-9d04-0233ef59dc45", "tag": "cbb52976-7d32-47e8-a00a-a0efa3d3f95a"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:32:48.108457 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:32:48.108457 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:32:48.116414 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-28fb6f09-fc86-439b-990d-2619e35d1760 req-a42a6b9d-d65f-42fb-ae48-b043ff470bad service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:32:48.116914 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-28fb6f09-fc86-439b-990d-2619e35d1760 req-a42a6b9d-d65f-42fb-ae48-b043ff470bad service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:32:48.127717 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-28fb6f09-fc86-439b-990d-2619e35d1760 req-a42a6b9d-d65f-42fb-ae48-b043ff470bad service nova] Creating event network-changed:cbb52976-7d32-47e8-a00a-a0efa3d3f95a for instance 6e5253f7-3260-4ac4-9d04-0233ef59dc45 on hv-cinder-81803 Nov 19 03:32:48.133457 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-28fb6f09-fc86-439b-990d-2619e35d1760 req-a42a6b9d-d65f-42fb-ae48-b043ff470bad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031328 Nov 19 03:32:48.134184 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 698/1312] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:32:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:33:11.141665 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b69f5a7a-9d95-4f2f-be96-210d8ca5b197 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Action: 'create', calling method: .version_select at 0x7f845a174dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1388976346"}} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:33:11.155622 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-b69f5a7a-9d95-4f2f-be96-210d8ca5b197 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Getting quotas for project 5c1793e5d8d8432498e1c34ec1d15321. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:33:11.159390 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-b69f5a7a-9d95-4f2f-be96-210d8ca5b197 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Getting quotas for user 7e2083348f6849b5b31fde15ae29f84a and project 5c1793e5d8d8432498e1c34ec1d15321. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:33:11.247946 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-b69f5a7a-9d95-4f2f-be96-210d8ca5b197 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Getting quotas for project 5c1793e5d8d8432498e1c34ec1d15321. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:33:11.253123 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.quota [None req-b69f5a7a-9d95-4f2f-be96-210d8ca5b197 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Getting quotas for user 7e2083348f6849b5b31fde15ae29f84a and project 5c1793e5d8d8432498e1c34ec1d15321. Resources: {'key_pairs'} {{(pid=116066) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:33:11.267596 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b69f5a7a-9d95-4f2f-be96-210d8ca5b197 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.338719 Nov 19 03:33:11.268605 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 615/1313] 10.222.0.47 () {60 vars in 1157 bytes} [Fri Nov 19 03:33:10 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:33:37.030198 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-549692485", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1388976346", "security_groups": [{"name": "tempest-secgroup-smoke-374879915"}], "networks": [{"uuid": "797e4d8c-1166-41b8-be1d-e920f770d913"}], "block_device_mapping_v2": [{"uuid": "e96ab404-d7c2-4f3a-9dec-18140adf75f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:33:37.139026 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.network.neutron [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] validate_networks() for [('797e4d8c-1166-41b8-be1d-e920f770d913', None, None, None, None, None)] {{(pid=116065) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 03:33:37.500309 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Flavor limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 03:33:37.500677 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Image limits 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 03:33:37.501153 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Flavor pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 03:33:37.501562 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Image pref 0:0:0 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 03:33:37.501973 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.virt.hardware [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 03:33:37.510632 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:37.511088 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:37.511902 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:37.512341 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:37.529057 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Getting quotas for project 5c1793e5d8d8432498e1c34ec1d15321. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 03:33:37.533010 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.quota [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Getting quotas for user 7e2083348f6849b5b31fde15ae29f84a and project 5c1793e5d8d8432498e1c34ec1d15321. Resources: {'cores', 'instances', 'ram'} {{(pid=116065) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 03:33:37.587854 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Going to run 1 instances... {{(pid=116065) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 03:33:37.590042 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e96ab404-d7c2-4f3a-9dec-18140adf75f5',volume_size=None,volume_type=None)] {{(pid=116065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 03:33:37.708457 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-1e9f6194-e431-48ed-a131-a017ff85d683 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.682956 Nov 19 03:33:37.709097 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 699/1314] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Nov 19 03:33:37 2021] POST /compute/v2.1/servers => generated 405 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 03:33:37.719639 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-754230a8-80f0-4d6c-9b63-4716cb776199 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:37.720233 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-754230a8-80f0-4d6c-9b63-4716cb776199 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:37.772129 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-754230a8-80f0-4d6c-9b63-4716cb776199 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:37.779323 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-754230a8-80f0-4d6c-9b63-4716cb776199 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1088 microversion: 2.1 time: 0.063879 Nov 19 03:33:37.779882 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 616/1315] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:37 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1088 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:33:38.797292 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-80dc3b6a-e3b5-48b1-a895-2f8489c6c365 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:38.797904 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-80dc3b6a-e3b5-48b1-a895-2f8489c6c365 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:38.803984 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-80dc3b6a-e3b5-48b1-a895-2f8489c6c365 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:38.804432 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-80dc3b6a-e3b5-48b1-a895-2f8489c6c365 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:38.805214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-80dc3b6a-e3b5-48b1-a895-2f8489c6c365 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:38.805650 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-80dc3b6a-e3b5-48b1-a895-2f8489c6c365 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:38.874122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-80dc3b6a-e3b5-48b1-a895-2f8489c6c365 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:38.882166 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-80dc3b6a-e3b5-48b1-a895-2f8489c6c365 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1204 microversion: 2.1 time: 0.088130 Nov 19 03:33:38.891948 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 700/1316] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:38 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1204 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:39.900690 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-fe1b670e-5d94-4a48-9c95-1cdec94b60d8 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:39.902190 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-fe1b670e-5d94-4a48-9c95-1cdec94b60d8 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:39.910834 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fe1b670e-5d94-4a48-9c95-1cdec94b60d8 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:39.911394 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fe1b670e-5d94-4a48-9c95-1cdec94b60d8 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:39.912335 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fe1b670e-5d94-4a48-9c95-1cdec94b60d8 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:39.912874 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-fe1b670e-5d94-4a48-9c95-1cdec94b60d8 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:40.107768 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-fe1b670e-5d94-4a48-9c95-1cdec94b60d8 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:40.116983 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-fe1b670e-5d94-4a48-9c95-1cdec94b60d8 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1259 microversion: 2.1 time: 0.221120 Nov 19 03:33:40.117672 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 617/1317] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:39 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:40.168290 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-309b288a-12ad-4109-808e-a798ee36b44f req-4f39c870-38e0-40fd-808f-4264c3463179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7869e9-27fc-4ff5-98fd-b43c6d0f8039", "tag": "c84948e6-48aa-4445-a165-19b370bebd0b"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:33:40.169901 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:33:40.169901 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:33:40.177606 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-309b288a-12ad-4109-808e-a798ee36b44f req-4f39c870-38e0-40fd-808f-4264c3463179 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:40.178571 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-309b288a-12ad-4109-808e-a798ee36b44f req-4f39c870-38e0-40fd-808f-4264c3463179 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:40.197831 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-309b288a-12ad-4109-808e-a798ee36b44f req-4f39c870-38e0-40fd-808f-4264c3463179 service nova] Creating event network-changed:c84948e6-48aa-4445-a165-19b370bebd0b for instance dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 on hv-cinder-81803 Nov 19 03:33:40.202976 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-309b288a-12ad-4109-808e-a798ee36b44f req-4f39c870-38e0-40fd-808f-4264c3463179 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038355 Nov 19 03:33:40.203588 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 701/1318] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:33:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:33:41.133541 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-374bffe3-b589-4fb4-98df-42f5f0c5199d tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:41.134090 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-374bffe3-b589-4fb4-98df-42f5f0c5199d tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:41.140212 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-374bffe3-b589-4fb4-98df-42f5f0c5199d tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:41.140671 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-374bffe3-b589-4fb4-98df-42f5f0c5199d tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:41.141417 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-374bffe3-b589-4fb4-98df-42f5f0c5199d tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:41.141845 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-374bffe3-b589-4fb4-98df-42f5f0c5199d tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:41.274843 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-374bffe3-b589-4fb4-98df-42f5f0c5199d tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:41.281935 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-374bffe3-b589-4fb4-98df-42f5f0c5199d tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1259 microversion: 2.1 time: 0.152112 Nov 19 03:33:41.282513 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 618/1319] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:41 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:42.299808 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3812077d-0318-4279-9809-608aab147f00 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:42.300530 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3812077d-0318-4279-9809-608aab147f00 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:42.307552 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3812077d-0318-4279-9809-608aab147f00 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:42.307999 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3812077d-0318-4279-9809-608aab147f00 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:42.308803 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3812077d-0318-4279-9809-608aab147f00 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:42.309238 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3812077d-0318-4279-9809-608aab147f00 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:42.443172 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3812077d-0318-4279-9809-608aab147f00 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:42.451483 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3812077d-0318-4279-9809-608aab147f00 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1259 microversion: 2.1 time: 0.155617 Nov 19 03:33:42.452050 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 702/1320] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:42 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:43.468214 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-12ce7a2d-fbe1-45c5-8125-8f28bf064fc7 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:43.468815 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-12ce7a2d-fbe1-45c5-8125-8f28bf064fc7 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:43.476308 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-12ce7a2d-fbe1-45c5-8125-8f28bf064fc7 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:43.476758 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-12ce7a2d-fbe1-45c5-8125-8f28bf064fc7 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:43.477553 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-12ce7a2d-fbe1-45c5-8125-8f28bf064fc7 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:43.478001 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-12ce7a2d-fbe1-45c5-8125-8f28bf064fc7 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:43.607488 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-12ce7a2d-fbe1-45c5-8125-8f28bf064fc7 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:43.614793 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-12ce7a2d-fbe1-45c5-8125-8f28bf064fc7 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1259 microversion: 2.1 time: 0.150287 Nov 19 03:33:43.615966 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 619/1321] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:43 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:44.632590 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2978b512-7a81-4ea4-938f-b33752149083 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:44.633200 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2978b512-7a81-4ea4-938f-b33752149083 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:44.639477 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2978b512-7a81-4ea4-938f-b33752149083 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:44.639922 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2978b512-7a81-4ea4-938f-b33752149083 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:44.640695 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2978b512-7a81-4ea4-938f-b33752149083 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:44.641129 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2978b512-7a81-4ea4-938f-b33752149083 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:44.769798 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2978b512-7a81-4ea4-938f-b33752149083 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:44.777169 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2978b512-7a81-4ea4-938f-b33752149083 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1259 microversion: 2.1 time: 0.148864 Nov 19 03:33:44.777737 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 703/1322] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:44 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:45.793947 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-77494926-5e6e-4db4-8cfc-bb077102ad53 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:45.794635 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-77494926-5e6e-4db4-8cfc-bb077102ad53 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:45.800868 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-77494926-5e6e-4db4-8cfc-bb077102ad53 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:45.801316 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-77494926-5e6e-4db4-8cfc-bb077102ad53 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:45.802084 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-77494926-5e6e-4db4-8cfc-bb077102ad53 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:45.803390 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-77494926-5e6e-4db4-8cfc-bb077102ad53 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:45.938025 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-77494926-5e6e-4db4-8cfc-bb077102ad53 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:45.945179 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-77494926-5e6e-4db4-8cfc-bb077102ad53 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1259 microversion: 2.1 time: 0.154957 Nov 19 03:33:45.945734 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 620/1323] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:45 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:46.962093 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e8024758-8e6a-4e6b-b6cc-89a5059d3a3f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:46.962735 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e8024758-8e6a-4e6b-b6cc-89a5059d3a3f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:46.969037 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e8024758-8e6a-4e6b-b6cc-89a5059d3a3f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:46.969488 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e8024758-8e6a-4e6b-b6cc-89a5059d3a3f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:46.970274 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e8024758-8e6a-4e6b-b6cc-89a5059d3a3f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:46.970736 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e8024758-8e6a-4e6b-b6cc-89a5059d3a3f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:47.103652 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-e8024758-8e6a-4e6b-b6cc-89a5059d3a3f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:47.111081 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e8024758-8e6a-4e6b-b6cc-89a5059d3a3f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1259 microversion: 2.1 time: 0.152670 Nov 19 03:33:47.111654 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 704/1324] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:46 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:48.128210 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4dfb99dc-f4a1-4ff2-8601-c3a0cf2de8fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:48.128816 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4dfb99dc-f4a1-4ff2-8601-c3a0cf2de8fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:48.135274 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4dfb99dc-f4a1-4ff2-8601-c3a0cf2de8fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:48.135725 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4dfb99dc-f4a1-4ff2-8601-c3a0cf2de8fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:48.136543 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4dfb99dc-f4a1-4ff2-8601-c3a0cf2de8fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:48.136974 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4dfb99dc-f4a1-4ff2-8601-c3a0cf2de8fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:48.269734 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-4dfb99dc-f4a1-4ff2-8601-c3a0cf2de8fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:48.277714 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4dfb99dc-f4a1-4ff2-8601-c3a0cf2de8fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1259 microversion: 2.1 time: 0.153139 Nov 19 03:33:48.278278 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 621/1325] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:48 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:49.295899 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c872cf30-c9db-4f48-beeb-8100ad8c1ce6 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:49.296590 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c872cf30-c9db-4f48-beeb-8100ad8c1ce6 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:49.303336 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c872cf30-c9db-4f48-beeb-8100ad8c1ce6 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:49.304410 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c872cf30-c9db-4f48-beeb-8100ad8c1ce6 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:49.305389 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c872cf30-c9db-4f48-beeb-8100ad8c1ce6 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:49.305820 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c872cf30-c9db-4f48-beeb-8100ad8c1ce6 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:49.439194 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c872cf30-c9db-4f48-beeb-8100ad8c1ce6 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:49.446615 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c872cf30-c9db-4f48-beeb-8100ad8c1ce6 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1259 microversion: 2.1 time: 0.154525 Nov 19 03:33:49.447177 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 705/1326] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:49 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:33:50.463450 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-4d1ef011-1100-4897-8971-2163bf8cb955 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:50.464241 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-4d1ef011-1100-4897-8971-2163bf8cb955 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:50.470275 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4d1ef011-1100-4897-8971-2163bf8cb955 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:50.470759 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4d1ef011-1100-4897-8971-2163bf8cb955 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:50.471527 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4d1ef011-1100-4897-8971-2163bf8cb955 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:50.471956 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-4d1ef011-1100-4897-8971-2163bf8cb955 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:50.602918 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-4d1ef011-1100-4897-8971-2163bf8cb955 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:50.610603 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-4d1ef011-1100-4897-8971-2163bf8cb955 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1259 microversion: 2.1 time: 0.150923 Nov 19 03:33:50.611172 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 622/1327] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:50 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:51.627654 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3c61e15c-ca41-4aa0-bbe3-290007cf5e8f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:51.628256 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3c61e15c-ca41-4aa0-bbe3-290007cf5e8f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:51.635224 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3c61e15c-ca41-4aa0-bbe3-290007cf5e8f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:51.635666 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3c61e15c-ca41-4aa0-bbe3-290007cf5e8f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:51.636433 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3c61e15c-ca41-4aa0-bbe3-290007cf5e8f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:51.636873 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3c61e15c-ca41-4aa0-bbe3-290007cf5e8f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:51.645155 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-a89203ce-7b53-4101-af34-778d3126e2b9 req-6c62f87d-593e-4ca5-b3d9-ab545e5e9d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7869e9-27fc-4ff5-98fd-b43c6d0f8039", "name": "network-vif-plugged", "status": "completed", "tag": "c84948e6-48aa-4445-a165-19b370bebd0b"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:33:51.646670 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:33:51.646670 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:33:51.654493 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-a89203ce-7b53-4101-af34-778d3126e2b9 req-6c62f87d-593e-4ca5-b3d9-ab545e5e9d3d service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:51.654962 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-a89203ce-7b53-4101-af34-778d3126e2b9 req-6c62f87d-593e-4ca5-b3d9-ab545e5e9d3d service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:51.666454 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-a89203ce-7b53-4101-af34-778d3126e2b9 req-6c62f87d-593e-4ca5-b3d9-ab545e5e9d3d service nova] Creating event network-vif-plugged:c84948e6-48aa-4445-a165-19b370bebd0b for instance dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 on hv-cinder-81803 Nov 19 03:33:51.671644 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-a89203ce-7b53-4101-af34-778d3126e2b9 req-6c62f87d-593e-4ca5-b3d9-ab545e5e9d3d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029825 Nov 19 03:33:51.672300 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 623/1328] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:33:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:33:51.783883 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3c61e15c-ca41-4aa0-bbe3-290007cf5e8f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:51.791779 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3c61e15c-ca41-4aa0-bbe3-290007cf5e8f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1259 microversion: 2.1 time: 0.167733 Nov 19 03:33:51.792357 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 706/1329] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:51 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:52.811238 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-dca9cb72-03cb-4d03-a6b3-55d47b033af4 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:52.811924 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-dca9cb72-03cb-4d03-a6b3-55d47b033af4 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:52.817984 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dca9cb72-03cb-4d03-a6b3-55d47b033af4 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:52.818425 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dca9cb72-03cb-4d03-a6b3-55d47b033af4 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:52.819336 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dca9cb72-03cb-4d03-a6b3-55d47b033af4 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:52.820054 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-dca9cb72-03cb-4d03-a6b3-55d47b033af4 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:52.952705 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-dca9cb72-03cb-4d03-a6b3-55d47b033af4 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:52.960599 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-dca9cb72-03cb-4d03-a6b3-55d47b033af4 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1259 microversion: 2.1 time: 0.153185 Nov 19 03:33:52.961340 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 624/1330] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:52 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:53.978205 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-d9e4a4a5-5778-44d3-b673-f29e1df5b0de tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:53.978873 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-d9e4a4a5-5778-44d3-b673-f29e1df5b0de tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:53.985198 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d9e4a4a5-5778-44d3-b673-f29e1df5b0de tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:53.985641 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d9e4a4a5-5778-44d3-b673-f29e1df5b0de tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:53.986446 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d9e4a4a5-5778-44d3-b673-f29e1df5b0de tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:53.986903 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-d9e4a4a5-5778-44d3-b673-f29e1df5b0de tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:54.127810 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-d9e4a4a5-5778-44d3-b673-f29e1df5b0de tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:54.138581 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-d9e4a4a5-5778-44d3-b673-f29e1df5b0de tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1442 microversion: 2.1 time: 0.163674 Nov 19 03:33:54.139170 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 707/1331] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:53 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1442 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:54.158240 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-1067048b-1dee-4ec5-a257-f6c9780fe37e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:33:54.158866 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-1067048b-1dee-4ec5-a257-f6c9780fe37e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:33:54.165872 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1067048b-1dee-4ec5-a257-f6c9780fe37e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:54.166315 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1067048b-1dee-4ec5-a257-f6c9780fe37e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:54.167113 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1067048b-1dee-4ec5-a257-f6c9780fe37e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:54.167538 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-1067048b-1dee-4ec5-a257-f6c9780fe37e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:54.326972 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-1067048b-1dee-4ec5-a257-f6c9780fe37e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:33:54.334354 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-1067048b-1dee-4ec5-a257-f6c9780fe37e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1442 microversion: 2.1 time: 0.180384 Nov 19 03:33:54.335007 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 625/1332] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:33:54 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1442 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:33:56.270664 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-f7b13d75-7f33-4e98-956d-0da37e5e2e3f req-cbc1f3ef-13fb-43bb-96e0-4ac0055a2d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7869e9-27fc-4ff5-98fd-b43c6d0f8039", "tag": "c84948e6-48aa-4445-a165-19b370bebd0b"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:33:56.273079 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:33:56.273079 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:33:56.280473 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-f7b13d75-7f33-4e98-956d-0da37e5e2e3f req-cbc1f3ef-13fb-43bb-96e0-4ac0055a2d6a service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:33:56.281021 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-f7b13d75-7f33-4e98-956d-0da37e5e2e3f req-cbc1f3ef-13fb-43bb-96e0-4ac0055a2d6a service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:33:56.292956 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-f7b13d75-7f33-4e98-956d-0da37e5e2e3f req-cbc1f3ef-13fb-43bb-96e0-4ac0055a2d6a service nova] Creating event network-changed:c84948e6-48aa-4445-a165-19b370bebd0b for instance dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 on hv-cinder-81803 Nov 19 03:33:56.297997 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-f7b13d75-7f33-4e98-956d-0da37e5e2e3f req-cbc1f3ef-13fb-43bb-96e0-4ac0055a2d6a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031173 Nov 19 03:33:56.298800 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 708/1333] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:33:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:34:00.442008 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:34:00.442677 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: Fri Nov 19 03:34:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:34:52.030810 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-3efb27dc-bcae-4de1-a5ba-9930d5120b62 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:34:52.031502 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3efb27dc-bcae-4de1-a5ba-9930d5120b62 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:34:52.033953 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-619aa550-d82a-471e-9e0d-46dad83b2a3d req-e0df0b9f-e9de-4cab-80df-886144b3abc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5253f7-3260-4ac4-9d04-0233ef59dc45", "tag": "cbb52976-7d32-47e8-a00a-a0efa3d3f95a"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:34:52.036102 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:34:52.036102 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:34:52.039315 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3efb27dc-bcae-4de1-a5ba-9930d5120b62 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:52.039834 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3efb27dc-bcae-4de1-a5ba-9930d5120b62 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:52.040687 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3efb27dc-bcae-4de1-a5ba-9930d5120b62 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:52.041321 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-3efb27dc-bcae-4de1-a5ba-9930d5120b62 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:52.043492 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-619aa550-d82a-471e-9e0d-46dad83b2a3d req-e0df0b9f-e9de-4cab-80df-886144b3abc3 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:52.044132 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-619aa550-d82a-471e-9e0d-46dad83b2a3d req-e0df0b9f-e9de-4cab-80df-886144b3abc3 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:52.055675 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-619aa550-d82a-471e-9e0d-46dad83b2a3d req-e0df0b9f-e9de-4cab-80df-886144b3abc3 service nova] Creating event network-changed:cbb52976-7d32-47e8-a00a-a0efa3d3f95a for instance 6e5253f7-3260-4ac4-9d04-0233ef59dc45 on hv-cinder-81803 Nov 19 03:34:52.060983 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-619aa550-d82a-471e-9e0d-46dad83b2a3d req-e0df0b9f-e9de-4cab-80df-886144b3abc3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031282 Nov 19 03:34:52.061771 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 709/1334] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:34:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:34:52.068839 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-3efb27dc-bcae-4de1-a5ba-9930d5120b62 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Going to try to terminate instance {{(pid=116066) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:34:52.155323 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-3efb27dc-bcae-4de1-a5ba-9930d5120b62 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 204 len: 0 microversion: 2.1 time: 0.127439 Nov 19 03:34:52.157973 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 626/1335] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:34:52 2021] DELETE /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:34:52.166690 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-bcb1c87d-b780-45f4-bd23-1a49164abcfd tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:34:52.167447 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-bcb1c87d-b780-45f4-bd23-1a49164abcfd tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:34:52.174848 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bcb1c87d-b780-45f4-bd23-1a49164abcfd tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:52.175320 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bcb1c87d-b780-45f4-bd23-1a49164abcfd tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:52.176225 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bcb1c87d-b780-45f4-bd23-1a49164abcfd tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:52.176572 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-bcb1c87d-b780-45f4-bd23-1a49164abcfd tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:52.423249 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-bcb1c87d-b780-45f4-bd23-1a49164abcfd tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:34:52.431716 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-bcb1c87d-b780-45f4-bd23-1a49164abcfd tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1577 microversion: 2.1 time: 0.269833 Nov 19 03:34:52.443970 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 710/1336] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:34:52 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1577 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:34:53.451706 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ce95b189-b23f-44c8-a4ef-f9c8c732c1d4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:34:53.452396 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ce95b189-b23f-44c8-a4ef-f9c8c732c1d4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:34:53.459097 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ce95b189-b23f-44c8-a4ef-f9c8c732c1d4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:53.459536 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ce95b189-b23f-44c8-a4ef-f9c8c732c1d4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:53.460296 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ce95b189-b23f-44c8-a4ef-f9c8c732c1d4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:53.460722 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ce95b189-b23f-44c8-a4ef-f9c8c732c1d4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:53.598209 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ce95b189-b23f-44c8-a4ef-f9c8c732c1d4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:34:53.605475 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ce95b189-b23f-44c8-a4ef-f9c8c732c1d4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1458 microversion: 2.1 time: 0.157766 Nov 19 03:34:53.606047 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 627/1337] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:34:53 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1458 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:34:54.623041 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3618ba71-5ebc-4d4d-b932-17a1813e064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:34:54.623660 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3618ba71-5ebc-4d4d-b932-17a1813e064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:34:54.631038 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3618ba71-5ebc-4d4d-b932-17a1813e064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:54.631564 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3618ba71-5ebc-4d4d-b932-17a1813e064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:54.632258 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3618ba71-5ebc-4d4d-b932-17a1813e064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:54.632696 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3618ba71-5ebc-4d4d-b932-17a1813e064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:54.654951 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-aa3398b4-bef7-47ff-aa73-f8dc2d059a76 req-00ffb05f-3c71-4178-aeb8-5e2d4ece4727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5253f7-3260-4ac4-9d04-0233ef59dc45", "name": "network-vif-deleted", "tag": "cbb52976-7d32-47e8-a00a-a0efa3d3f95a"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:34:54.656692 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:34:54.656692 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:34:54.664572 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-aa3398b4-bef7-47ff-aa73-f8dc2d059a76 req-00ffb05f-3c71-4178-aeb8-5e2d4ece4727 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:54.665262 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-aa3398b4-bef7-47ff-aa73-f8dc2d059a76 req-00ffb05f-3c71-4178-aeb8-5e2d4ece4727 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:54.677369 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-aa3398b4-bef7-47ff-aa73-f8dc2d059a76 req-00ffb05f-3c71-4178-aeb8-5e2d4ece4727 service nova] Creating event network-vif-deleted:cbb52976-7d32-47e8-a00a-a0efa3d3f95a for instance 6e5253f7-3260-4ac4-9d04-0233ef59dc45 on hv-cinder-81803 Nov 19 03:34:54.682711 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-aa3398b4-bef7-47ff-aa73-f8dc2d059a76 req-00ffb05f-3c71-4178-aeb8-5e2d4ece4727 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031816 Nov 19 03:34:54.683614 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 628/1338] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:34:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:34:54.700791 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3618ba71-5ebc-4d4d-b932-17a1813e064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:34:54.708870 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3618ba71-5ebc-4d4d-b932-17a1813e064a tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 200 len: 1390 microversion: 2.1 time: 0.089494 Nov 19 03:34:54.715358 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 711/1339] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:34:54 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:34:55.726728 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e0a20824-a462-422a-bca7-6b4a7aeaf812 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:34:55.727417 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-e0a20824-a462-422a-bca7-6b4a7aeaf812 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 6e5253f7-3260-4ac4-9d04-0233ef59dc45] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:34:55.733572 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e0a20824-a462-422a-bca7-6b4a7aeaf812 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:55.733945 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e0a20824-a462-422a-bca7-6b4a7aeaf812 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:55.734733 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e0a20824-a462-422a-bca7-6b4a7aeaf812 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:55.735159 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-e0a20824-a462-422a-bca7-6b4a7aeaf812 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:55.748916 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-e0a20824-a462-422a-bca7-6b4a7aeaf812 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] HTTP exception thrown: Instance 6e5253f7-3260-4ac4-9d04-0233ef59dc45 could not be found. Nov 19 03:34:55.749497 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-e0a20824-a462-422a-bca7-6b4a7aeaf812 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Returning 404 to user: Instance 6e5253f7-3260-4ac4-9d04-0233ef59dc45 could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:34:55.750313 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-e0a20824-a462-422a-bca7-6b4a7aeaf812 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45" status: 404 len: 111 microversion: 2.1 time: 0.028672 Nov 19 03:34:55.750885 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 629/1340] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:34:55 2021] GET /compute/v2.1/servers/6e5253f7-3260-4ac4-9d04-0233ef59dc45 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:34:57.240201 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:34:57.240796 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: Fri Nov 19 03:34:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:34:59.056232 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-96490b0b-6718-4591-8f6d-dcb3847ea03d req-e1520e00-8056-4586-9cc1-0ca1933ea532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2791816b-a24f-4393-b909-931a52e455a1", "tag": "ad396234-a82d-422a-9ca4-4d3f85240b28"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:34:59.057717 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:34:59.057717 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:34:59.058821 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-288013d6-3bc1-4a31-904d-4c1a65c40c7f tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:34:59.059691 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-288013d6-3bc1-4a31-904d-4c1a65c40c7f tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:34:59.066271 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-288013d6-3bc1-4a31-904d-4c1a65c40c7f tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:59.068002 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-288013d6-3bc1-4a31-904d-4c1a65c40c7f tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:59.072465 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-288013d6-3bc1-4a31-904d-4c1a65c40c7f tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:59.072465 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-288013d6-3bc1-4a31-904d-4c1a65c40c7f tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:59.072697 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-96490b0b-6718-4591-8f6d-dcb3847ea03d req-e1520e00-8056-4586-9cc1-0ca1933ea532 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:59.072992 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-96490b0b-6718-4591-8f6d-dcb3847ea03d req-e1520e00-8056-4586-9cc1-0ca1933ea532 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:59.083740 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-96490b0b-6718-4591-8f6d-dcb3847ea03d req-e1520e00-8056-4586-9cc1-0ca1933ea532 service nova] Creating event network-changed:ad396234-a82d-422a-9ca4-4d3f85240b28 for instance 2791816b-a24f-4393-b909-931a52e455a1 on hv-cinder-81803 Nov 19 03:34:59.089060 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-96490b0b-6718-4591-8f6d-dcb3847ea03d req-e1520e00-8056-4586-9cc1-0ca1933ea532 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036308 Nov 19 03:34:59.090240 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 630/1341] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:34:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:34:59.102175 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-288013d6-3bc1-4a31-904d-4c1a65c40c7f tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Going to try to terminate instance {{(pid=116065) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:34:59.192171 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-288013d6-3bc1-4a31-904d-4c1a65c40c7f tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 204 len: 0 microversion: 2.1 time: 0.144240 Nov 19 03:34:59.192741 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 712/1342] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:34:59 2021] DELETE /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 03:34:59.201110 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-c5e9a9cb-a4d8-461e-8dd2-e545e62d5037 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:34:59.201788 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-c5e9a9cb-a4d8-461e-8dd2-e545e62d5037 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:34:59.208434 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c5e9a9cb-a4d8-461e-8dd2-e545e62d5037 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:59.208886 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c5e9a9cb-a4d8-461e-8dd2-e545e62d5037 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:59.209662 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c5e9a9cb-a4d8-461e-8dd2-e545e62d5037 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:34:59.210321 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-c5e9a9cb-a4d8-461e-8dd2-e545e62d5037 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:34:59.425669 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-c5e9a9cb-a4d8-461e-8dd2-e545e62d5037 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:34:59.433466 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-c5e9a9cb-a4d8-461e-8dd2-e545e62d5037 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1578 microversion: 2.1 time: 0.236236 Nov 19 03:34:59.444866 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 631/1343] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:34:59 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1578 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:35:00.451539 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-b2f3decc-58df-4736-8258-33964ae8587c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:35:00.452238 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-b2f3decc-58df-4736-8258-33964ae8587c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:35:00.459542 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b2f3decc-58df-4736-8258-33964ae8587c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:35:00.460036 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b2f3decc-58df-4736-8258-33964ae8587c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:35:00.460824 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b2f3decc-58df-4736-8258-33964ae8587c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:35:00.461252 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-b2f3decc-58df-4736-8258-33964ae8587c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:35:00.529334 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-b2f3decc-58df-4736-8258-33964ae8587c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46cac61c2b3543fb8be6fbab87677bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b123731cbb4468b8bae663587e792e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:35:00.537849 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-b2f3decc-58df-4736-8258-33964ae8587c tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 200 len: 1391 microversion: 2.1 time: 0.090525 Nov 19 03:35:00.538426 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 713/1344] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:35:00 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 1391 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:35:01.104875 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-640c5897-a7be-4a54-b221-ad50606e233f req-2f14ec45-3889-431d-87bd-a760bd4762b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2791816b-a24f-4393-b909-931a52e455a1", "name": "network-vif-deleted", "tag": "ad396234-a82d-422a-9ca4-4d3f85240b28"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:35:01.106354 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:35:01.106354 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:35:01.114298 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-640c5897-a7be-4a54-b221-ad50606e233f req-2f14ec45-3889-431d-87bd-a760bd4762b3 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:35:01.114920 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-640c5897-a7be-4a54-b221-ad50606e233f req-2f14ec45-3889-431d-87bd-a760bd4762b3 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:35:01.126874 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-640c5897-a7be-4a54-b221-ad50606e233f req-2f14ec45-3889-431d-87bd-a760bd4762b3 service nova] Creating event network-vif-deleted:ad396234-a82d-422a-9ca4-4d3f85240b28 for instance 2791816b-a24f-4393-b909-931a52e455a1 on hv-cinder-81803 Nov 19 03:35:01.132255 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-640c5897-a7be-4a54-b221-ad50606e233f req-2f14ec45-3889-431d-87bd-a760bd4762b3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030818 Nov 19 03:35:01.132843 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 632/1345] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:35:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:35:01.554758 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e31d32ca-fe3f-4eaa-9f49-353e6fadb0e8 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:35:01.555339 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e31d32ca-fe3f-4eaa-9f49-353e6fadb0e8 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: 2791816b-a24f-4393-b909-931a52e455a1] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:35:01.562011 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e31d32ca-fe3f-4eaa-9f49-353e6fadb0e8 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:35:01.562492 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e31d32ca-fe3f-4eaa-9f49-353e6fadb0e8 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:35:01.563274 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e31d32ca-fe3f-4eaa-9f49-353e6fadb0e8 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:35:01.563702 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e31d32ca-fe3f-4eaa-9f49-353e6fadb0e8 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:35:01.576694 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-e31d32ca-fe3f-4eaa-9f49-353e6fadb0e8 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] HTTP exception thrown: Instance 2791816b-a24f-4393-b909-931a52e455a1 could not be found. Nov 19 03:35:01.577268 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e31d32ca-fe3f-4eaa-9f49-353e6fadb0e8 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Returning 404 to user: Instance 2791816b-a24f-4393-b909-931a52e455a1 could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:35:01.578069 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e31d32ca-fe3f-4eaa-9f49-353e6fadb0e8 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1" status: 404 len: 111 microversion: 2.1 time: 0.027040 Nov 19 03:35:01.578624 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 714/1346] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:35:01 2021] GET /compute/v2.1/servers/2791816b-a24f-4393-b909-931a52e455a1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:35:02.028093 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5db363f9-3fb4-415a-a425-a086490d10fa tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:35:02.028680 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-5db363f9-3fb4-415a-a425-a086490d10fa tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:35:02.034909 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5db363f9-3fb4-415a-a425-a086490d10fa tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:35:02.036007 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5db363f9-3fb4-415a-a425-a086490d10fa tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:35:02.037036 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5db363f9-3fb4-415a-a425-a086490d10fa tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:35:02.037471 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-5db363f9-3fb4-415a-a425-a086490d10fa tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:35:02.050246 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-5db363f9-3fb4-415a-a425-a086490d10fa tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] HTTP exception thrown: Instance d415530f-d634-4a3a-bf17-d3574e19d21f could not be found. Nov 19 03:35:02.050875 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-5db363f9-3fb4-415a-a425-a086490d10fa tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Returning 404 to user: Instance d415530f-d634-4a3a-bf17-d3574e19d21f could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:35:02.051677 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-5db363f9-3fb4-415a-a425-a086490d10fa tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 404 len: 111 microversion: 2.1 time: 0.027656 Nov 19 03:35:02.052190 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 633/1347] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:35:02 2021] DELETE /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:35:02.059997 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-065d5110-8e6f-49bc-b4d0-2c4411a734a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:35:02.060607 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-065d5110-8e6f-49bc-b4d0-2c4411a734a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] [instance: d415530f-d634-4a3a-bf17-d3574e19d21f] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:35:02.066640 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-065d5110-8e6f-49bc-b4d0-2c4411a734a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:35:02.067255 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-065d5110-8e6f-49bc-b4d0-2c4411a734a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:35:02.068027 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-065d5110-8e6f-49bc-b4d0-2c4411a734a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:35:02.068460 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-065d5110-8e6f-49bc-b4d0-2c4411a734a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:35:02.081449 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.wsgi [None req-065d5110-8e6f-49bc-b4d0-2c4411a734a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] HTTP exception thrown: Instance d415530f-d634-4a3a-bf17-d3574e19d21f could not be found. Nov 19 03:35:02.082827 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-065d5110-8e6f-49bc-b4d0-2c4411a734a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Returning 404 to user: Instance d415530f-d634-4a3a-bf17-d3574e19d21f could not be found. {{(pid=116065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:35:02.083789 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-065d5110-8e6f-49bc-b4d0-2c4411a734a4 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f" status: 404 len: 111 microversion: 2.1 time: 0.027439 Nov 19 03:35:02.084320 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 715/1348] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:35:02 2021] GET /compute/v2.1/servers/d415530f-d634-4a3a-bf17-d3574e19d21f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:35:03.362234 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-f8645947-d418-49c9-bd10-179701741cf9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] Calling method '.version_select at 0x7f845a090820>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:35:03.382231 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-f8645947-d418-49c9-bd10-179701741cf9 tempest-TestVolumeBootPattern-1921142223 tempest-TestVolumeBootPattern-1921142223-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-884116023" status: 202 len: 0 microversion: 2.1 time: 0.023562 Nov 19 03:35:03.382843 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 634/1349] 10.222.0.47 () {58 vars in 1259 bytes} [Fri Nov 19 03:35:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-884116023 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:36:11.089522 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-5aceaeed-8cfc-4d6b-879a-9610c789b468 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:36:11.090065 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-5aceaeed-8cfc-4d6b-879a-9610c789b468 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:11.096090 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5aceaeed-8cfc-4d6b-879a-9610c789b468 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:11.096533 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5aceaeed-8cfc-4d6b-879a-9610c789b468 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:11.097291 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5aceaeed-8cfc-4d6b-879a-9610c789b468 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:11.097722 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-5aceaeed-8cfc-4d6b-879a-9610c789b468 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:11.120206 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.objects.instance [None req-5aceaeed-8cfc-4d6b-879a-9610c789b468 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lazy-loading 'flavor' on Instance uuid dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 {{(pid=116065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 03:36:11.188516 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-5aceaeed-8cfc-4d6b-879a-9610c789b468 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "POST /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039/action" status: 202 len: 0 microversion: 2.1 time: 0.103300 Nov 19 03:36:11.189092 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 716/1350] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:36:11 2021] POST /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:36:11.199611 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-9eae9de1-2810-4186-ad45-4880e2c28410 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:11.200223 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-9eae9de1-2810-4186-ad45-4880e2c28410 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:11.207168 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9eae9de1-2810-4186-ad45-4880e2c28410 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:11.207619 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9eae9de1-2810-4186-ad45-4880e2c28410 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:11.208426 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9eae9de1-2810-4186-ad45-4880e2c28410 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:11.209046 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-9eae9de1-2810-4186-ad45-4880e2c28410 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:11.567818 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-9eae9de1-2810-4186-ad45-4880e2c28410 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:11.575146 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-9eae9de1-2810-4186-ad45-4880e2c28410 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1567 microversion: 2.1 time: 0.380970 Nov 19 03:36:11.575702 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 635/1351] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:11 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1567 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 03:36:12.593957 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f4f05b13-b4b7-4db4-bca6-c2e02f1a0318 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:12.594745 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f4f05b13-b4b7-4db4-bca6-c2e02f1a0318 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:12.601044 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4f05b13-b4b7-4db4-bca6-c2e02f1a0318 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:12.601484 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4f05b13-b4b7-4db4-bca6-c2e02f1a0318 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:12.602308 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4f05b13-b4b7-4db4-bca6-c2e02f1a0318 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:12.602764 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f4f05b13-b4b7-4db4-bca6-c2e02f1a0318 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:12.786746 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f4f05b13-b4b7-4db4-bca6-c2e02f1a0318 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:12.794148 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f4f05b13-b4b7-4db4-bca6-c2e02f1a0318 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1567 microversion: 2.1 time: 0.205077 Nov 19 03:36:12.794735 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 717/1352] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:12 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:13.811961 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-34dcd67f-317a-48a3-ac02-dd72894985a5 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:13.812560 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-34dcd67f-317a-48a3-ac02-dd72894985a5 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:13.818899 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34dcd67f-317a-48a3-ac02-dd72894985a5 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:13.819338 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34dcd67f-317a-48a3-ac02-dd72894985a5 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:13.820095 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34dcd67f-317a-48a3-ac02-dd72894985a5 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:13.820567 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-34dcd67f-317a-48a3-ac02-dd72894985a5 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:13.955484 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-34dcd67f-317a-48a3-ac02-dd72894985a5 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:13.963365 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-34dcd67f-317a-48a3-ac02-dd72894985a5 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1567 microversion: 2.1 time: 0.155055 Nov 19 03:36:13.963922 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 636/1353] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:13 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:14.980195 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-f7eed5bd-1044-4cff-ab7a-185ac77ebb4e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:14.980805 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-f7eed5bd-1044-4cff-ab7a-185ac77ebb4e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:14.987254 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f7eed5bd-1044-4cff-ab7a-185ac77ebb4e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:14.987699 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f7eed5bd-1044-4cff-ab7a-185ac77ebb4e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:14.988497 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f7eed5bd-1044-4cff-ab7a-185ac77ebb4e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:14.988983 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-f7eed5bd-1044-4cff-ab7a-185ac77ebb4e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:15.122875 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-f7eed5bd-1044-4cff-ab7a-185ac77ebb4e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:15.130972 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-f7eed5bd-1044-4cff-ab7a-185ac77ebb4e tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1567 microversion: 2.1 time: 0.154289 Nov 19 03:36:15.131537 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 718/1354] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:14 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:16.148496 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-92eddcf0-3c36-498b-9840-ed4ad9891da0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:16.149103 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-92eddcf0-3c36-498b-9840-ed4ad9891da0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:16.155413 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-92eddcf0-3c36-498b-9840-ed4ad9891da0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:16.155864 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-92eddcf0-3c36-498b-9840-ed4ad9891da0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:16.156638 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-92eddcf0-3c36-498b-9840-ed4ad9891da0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:16.157076 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-92eddcf0-3c36-498b-9840-ed4ad9891da0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:16.291186 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-92eddcf0-3c36-498b-9840-ed4ad9891da0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:16.298390 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-92eddcf0-3c36-498b-9840-ed4ad9891da0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1567 microversion: 2.1 time: 0.154231 Nov 19 03:36:16.298980 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 637/1355] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:16 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:17.315296 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-3d87ef4c-9522-4949-896d-286d965bd416 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:17.315940 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-3d87ef4c-9522-4949-896d-286d965bd416 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:17.322726 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3d87ef4c-9522-4949-896d-286d965bd416 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:17.323178 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3d87ef4c-9522-4949-896d-286d965bd416 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:17.324010 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3d87ef4c-9522-4949-896d-286d965bd416 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:17.324394 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-3d87ef4c-9522-4949-896d-286d965bd416 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:17.454439 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-3d87ef4c-9522-4949-896d-286d965bd416 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:17.461986 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-3d87ef4c-9522-4949-896d-286d965bd416 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1567 microversion: 2.1 time: 0.150357 Nov 19 03:36:17.462572 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 719/1356] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:17 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:18.479414 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b94b47ce-ab09-4254-8df8-d19d940a0ae0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:18.480011 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b94b47ce-ab09-4254-8df8-d19d940a0ae0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:18.486131 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b94b47ce-ab09-4254-8df8-d19d940a0ae0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:18.486607 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b94b47ce-ab09-4254-8df8-d19d940a0ae0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:18.487378 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b94b47ce-ab09-4254-8df8-d19d940a0ae0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:18.487805 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b94b47ce-ab09-4254-8df8-d19d940a0ae0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:18.619905 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b94b47ce-ab09-4254-8df8-d19d940a0ae0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:18.627174 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b94b47ce-ab09-4254-8df8-d19d940a0ae0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1567 microversion: 2.1 time: 0.151508 Nov 19 03:36:18.627728 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 638/1357] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:18 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:19.644160 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-2479d198-fc3c-4fc3-81bc-34ea6fb05586 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:19.644782 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-2479d198-fc3c-4fc3-81bc-34ea6fb05586 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:19.651109 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2479d198-fc3c-4fc3-81bc-34ea6fb05586 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:19.651589 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2479d198-fc3c-4fc3-81bc-34ea6fb05586 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:19.652361 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2479d198-fc3c-4fc3-81bc-34ea6fb05586 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:19.652797 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-2479d198-fc3c-4fc3-81bc-34ea6fb05586 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:19.786516 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-2479d198-fc3c-4fc3-81bc-34ea6fb05586 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:19.793777 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-2479d198-fc3c-4fc3-81bc-34ea6fb05586 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1567 microversion: 2.1 time: 0.153305 Nov 19 03:36:19.794343 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 720/1358] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:19 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:20.811849 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-b5078e19-298e-4260-8d9b-26e1223fac42 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:20.812451 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-b5078e19-298e-4260-8d9b-26e1223fac42 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:20.819663 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b5078e19-298e-4260-8d9b-26e1223fac42 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:20.820106 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b5078e19-298e-4260-8d9b-26e1223fac42 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:20.820917 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b5078e19-298e-4260-8d9b-26e1223fac42 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:20.821344 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-b5078e19-298e-4260-8d9b-26e1223fac42 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:20.950867 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-b5078e19-298e-4260-8d9b-26e1223fac42 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:20.958085 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-b5078e19-298e-4260-8d9b-26e1223fac42 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1567 microversion: 2.1 time: 0.149888 Nov 19 03:36:20.958676 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 639/1359] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:20 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:21.974912 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-72c63cb6-b8ee-4b4b-9073-02701b83205b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:21.975650 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-72c63cb6-b8ee-4b4b-9073-02701b83205b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:21.981903 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-72c63cb6-b8ee-4b4b-9073-02701b83205b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:21.982349 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-72c63cb6-b8ee-4b4b-9073-02701b83205b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:21.983163 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-72c63cb6-b8ee-4b4b-9073-02701b83205b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:21.983598 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-72c63cb6-b8ee-4b4b-9073-02701b83205b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:22.129996 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-72c63cb6-b8ee-4b4b-9073-02701b83205b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:22.137288 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-72c63cb6-b8ee-4b4b-9073-02701b83205b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1567 microversion: 2.1 time: 0.166016 Nov 19 03:36:22.137851 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 721/1360] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:21 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:23.153553 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-28caf53f-d179-4b7b-8da6-b2dbf300ba98 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:23.154158 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-28caf53f-d179-4b7b-8da6-b2dbf300ba98 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:23.161291 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-28caf53f-d179-4b7b-8da6-b2dbf300ba98 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:23.161736 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-28caf53f-d179-4b7b-8da6-b2dbf300ba98 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:23.162526 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-28caf53f-d179-4b7b-8da6-b2dbf300ba98 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:23.162959 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-28caf53f-d179-4b7b-8da6-b2dbf300ba98 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:23.295712 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-28caf53f-d179-4b7b-8da6-b2dbf300ba98 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:23.302955 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-28caf53f-d179-4b7b-8da6-b2dbf300ba98 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1567 microversion: 2.1 time: 0.152935 Nov 19 03:36:23.303514 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 640/1361] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:23 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:24.320504 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-fd1cbce7-dae0-48a4-97a2-d12d22d07d4f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:24.321122 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-fd1cbce7-dae0-48a4-97a2-d12d22d07d4f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:24.327473 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fd1cbce7-dae0-48a4-97a2-d12d22d07d4f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:24.327923 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fd1cbce7-dae0-48a4-97a2-d12d22d07d4f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:24.328709 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fd1cbce7-dae0-48a4-97a2-d12d22d07d4f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:24.329160 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-fd1cbce7-dae0-48a4-97a2-d12d22d07d4f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:24.465880 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-fd1cbce7-dae0-48a4-97a2-d12d22d07d4f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:24.473300 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-fd1cbce7-dae0-48a4-97a2-d12d22d07d4f tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1568 microversion: 2.1 time: 0.157274 Nov 19 03:36:24.473860 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 722/1362] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:24 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:24.489471 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a4d04798-9aea-4b78-bf3b-c759b2913203 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:36:24.490823 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a4d04798-9aea-4b78-bf3b-c759b2913203 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:24.496939 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a4d04798-9aea-4b78-bf3b-c759b2913203 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:24.497384 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a4d04798-9aea-4b78-bf3b-c759b2913203 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:24.498154 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a4d04798-9aea-4b78-bf3b-c759b2913203 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:24.498610 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a4d04798-9aea-4b78-bf3b-c759b2913203 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:24.584633 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a4d04798-9aea-4b78-bf3b-c759b2913203 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "POST /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039/action" status: 202 len: 0 microversion: 2.1 time: 0.098724 Nov 19 03:36:24.585239 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 641/1363] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Nov 19 03:36:24 2021] POST /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:36:24.593431 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a77f58f5-1012-46a6-b85c-ab3d24e13414 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:24.594076 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a77f58f5-1012-46a6-b85c-ab3d24e13414 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:24.600142 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a77f58f5-1012-46a6-b85c-ab3d24e13414 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:24.601003 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a77f58f5-1012-46a6-b85c-ab3d24e13414 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:24.601409 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a77f58f5-1012-46a6-b85c-ab3d24e13414 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:24.601851 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a77f58f5-1012-46a6-b85c-ab3d24e13414 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:24.774043 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a77f58f5-1012-46a6-b85c-ab3d24e13414 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:24.781542 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a77f58f5-1012-46a6-b85c-ab3d24e13414 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1516 microversion: 2.1 time: 0.191911 Nov 19 03:36:24.782116 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 723/1364] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:24 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:25.800343 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-19f4584b-3258-4bbe-9f06-92ea13b69380 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:25.800944 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-19f4584b-3258-4bbe-9f06-92ea13b69380 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:25.807437 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-19f4584b-3258-4bbe-9f06-92ea13b69380 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:25.807881 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-19f4584b-3258-4bbe-9f06-92ea13b69380 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:25.808689 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-19f4584b-3258-4bbe-9f06-92ea13b69380 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:25.809180 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-19f4584b-3258-4bbe-9f06-92ea13b69380 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:25.952639 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-19f4584b-3258-4bbe-9f06-92ea13b69380 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:25.960907 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-19f4584b-3258-4bbe-9f06-92ea13b69380 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1574 microversion: 2.1 time: 0.164994 Nov 19 03:36:25.961578 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 642/1365] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:25 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:26.979275 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-701dca0d-89f1-4049-ab05-551dfeaf91af tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:26.979892 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-701dca0d-89f1-4049-ab05-551dfeaf91af tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:26.986209 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-701dca0d-89f1-4049-ab05-551dfeaf91af tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:26.986696 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-701dca0d-89f1-4049-ab05-551dfeaf91af tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:26.987469 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-701dca0d-89f1-4049-ab05-551dfeaf91af tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:26.987902 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-701dca0d-89f1-4049-ab05-551dfeaf91af tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:27.120716 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-701dca0d-89f1-4049-ab05-551dfeaf91af tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:27.127970 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-701dca0d-89f1-4049-ab05-551dfeaf91af tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1574 microversion: 2.1 time: 0.152332 Nov 19 03:36:27.128540 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 724/1366] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:26 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:28.144810 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-0bb9d807-b001-4c16-9d60-37d49655bb4b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:28.145483 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-0bb9d807-b001-4c16-9d60-37d49655bb4b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:28.151781 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0bb9d807-b001-4c16-9d60-37d49655bb4b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:28.152221 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0bb9d807-b001-4c16-9d60-37d49655bb4b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:28.152969 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0bb9d807-b001-4c16-9d60-37d49655bb4b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:28.153398 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-0bb9d807-b001-4c16-9d60-37d49655bb4b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:28.281422 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-0bb9d807-b001-4c16-9d60-37d49655bb4b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:28.289237 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-0bb9d807-b001-4c16-9d60-37d49655bb4b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1574 microversion: 2.1 time: 0.148003 Nov 19 03:36:28.289830 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 643/1367] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:28 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:28.517052 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [req-0016257e-8b59-487a-9dd1-f3a65216b3fc req-8b62e7fc-018b-4cec-9520-4007f52f87ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7869e9-27fc-4ff5-98fd-b43c6d0f8039", "name": "network-vif-unplugged", "status": "completed", "tag": "c84948e6-48aa-4445-a165-19b370bebd0b"}]} {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:36:28.518569 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:36:28.518569 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: warnings.warn(msg) Nov 19 03:36:28.526175 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-0016257e-8b59-487a-9dd1-f3a65216b3fc req-8b62e7fc-018b-4cec-9520-4007f52f87ba service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:28.526647 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [req-0016257e-8b59-487a-9dd1-f3a65216b3fc req-8b62e7fc-018b-4cec-9520-4007f52f87ba service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:28.538656 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.compute.server_external_events [req-0016257e-8b59-487a-9dd1-f3a65216b3fc req-8b62e7fc-018b-4cec-9520-4007f52f87ba service nova] Creating event network-vif-unplugged:c84948e6-48aa-4445-a165-19b370bebd0b for instance dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 on hv-cinder-81803 Nov 19 03:36:28.543581 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [req-0016257e-8b59-487a-9dd1-f3a65216b3fc req-8b62e7fc-018b-4cec-9520-4007f52f87ba service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030129 Nov 19 03:36:28.544162 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 725/1368] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:36:28 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:36:29.306303 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-7031665b-03b0-4cbc-89d9-0d03123aa429 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:29.306921 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-7031665b-03b0-4cbc-89d9-0d03123aa429 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:29.313153 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7031665b-03b0-4cbc-89d9-0d03123aa429 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:29.313599 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7031665b-03b0-4cbc-89d9-0d03123aa429 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:29.314373 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7031665b-03b0-4cbc-89d9-0d03123aa429 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:29.314832 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-7031665b-03b0-4cbc-89d9-0d03123aa429 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:29.447796 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-7031665b-03b0-4cbc-89d9-0d03123aa429 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:29.455102 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-7031665b-03b0-4cbc-89d9-0d03123aa429 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1574 microversion: 2.1 time: 0.153221 Nov 19 03:36:29.455669 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 644/1369] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:29 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:30.472837 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-c20a6355-53e8-49a6-8ff6-7dc9bef4b247 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:30.473525 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-c20a6355-53e8-49a6-8ff6-7dc9bef4b247 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:30.480438 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c20a6355-53e8-49a6-8ff6-7dc9bef4b247 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:30.480881 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c20a6355-53e8-49a6-8ff6-7dc9bef4b247 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:30.481648 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c20a6355-53e8-49a6-8ff6-7dc9bef4b247 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:30.482075 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-c20a6355-53e8-49a6-8ff6-7dc9bef4b247 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:30.613082 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-c20a6355-53e8-49a6-8ff6-7dc9bef4b247 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:30.620517 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-c20a6355-53e8-49a6-8ff6-7dc9bef4b247 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1574 microversion: 2.1 time: 0.152109 Nov 19 03:36:30.621086 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 726/1370] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:30 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:31.637052 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-ae44eb0a-37c3-4f7c-aaef-5b2a851d34fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:31.637638 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-ae44eb0a-37c3-4f7c-aaef-5b2a851d34fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:31.643905 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ae44eb0a-37c3-4f7c-aaef-5b2a851d34fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:31.644346 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ae44eb0a-37c3-4f7c-aaef-5b2a851d34fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:31.645113 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ae44eb0a-37c3-4f7c-aaef-5b2a851d34fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:31.645540 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-ae44eb0a-37c3-4f7c-aaef-5b2a851d34fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:31.781554 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-ae44eb0a-37c3-4f7c-aaef-5b2a851d34fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:31.789301 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-ae44eb0a-37c3-4f7c-aaef-5b2a851d34fe tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1574 microversion: 2.1 time: 0.155909 Nov 19 03:36:31.789862 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 645/1371] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:31 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:32.806591 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8c4abda8-8ad7-42c1-a02d-af22717b42f0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:32.807197 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-8c4abda8-8ad7-42c1-a02d-af22717b42f0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:32.813414 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8c4abda8-8ad7-42c1-a02d-af22717b42f0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:32.813854 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8c4abda8-8ad7-42c1-a02d-af22717b42f0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:32.814641 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8c4abda8-8ad7-42c1-a02d-af22717b42f0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:32.815071 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-8c4abda8-8ad7-42c1-a02d-af22717b42f0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:32.947463 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-8c4abda8-8ad7-42c1-a02d-af22717b42f0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:32.954660 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8c4abda8-8ad7-42c1-a02d-af22717b42f0 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1574 microversion: 2.1 time: 0.152082 Nov 19 03:36:32.955220 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 727/1372] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:32 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:33.971793 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-d0e26e3b-f012-4a47-9dfc-cf9e412c1d6a tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:33.972399 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-d0e26e3b-f012-4a47-9dfc-cf9e412c1d6a tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:33.979190 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d0e26e3b-f012-4a47-9dfc-cf9e412c1d6a tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:33.979630 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d0e26e3b-f012-4a47-9dfc-cf9e412c1d6a tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:33.980399 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d0e26e3b-f012-4a47-9dfc-cf9e412c1d6a tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:33.980827 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-d0e26e3b-f012-4a47-9dfc-cf9e412c1d6a tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:34.114407 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-d0e26e3b-f012-4a47-9dfc-cf9e412c1d6a tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:34.122299 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-d0e26e3b-f012-4a47-9dfc-cf9e412c1d6a tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1574 microversion: 2.1 time: 0.154220 Nov 19 03:36:34.122895 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 646/1373] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:33 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:35.139212 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-754215ca-098d-4b44-8863-40a3860f8952 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:36:35.139809 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-754215ca-098d-4b44-8863-40a3860f8952 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:36:35.146255 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-754215ca-098d-4b44-8863-40a3860f8952 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:35.146786 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-754215ca-098d-4b44-8863-40a3860f8952 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:35.147676 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-754215ca-098d-4b44-8863-40a3860f8952 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:35.148116 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-754215ca-098d-4b44-8863-40a3860f8952 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:35.277777 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-754215ca-098d-4b44-8863-40a3860f8952 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:36:35.285305 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-754215ca-098d-4b44-8863-40a3860f8952 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1561 microversion: 2.1 time: 0.149763 Nov 19 03:36:35.285891 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 728/1374] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:36:35 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:36:38.299737 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:36:38.300386 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: Fri Nov 19 03:36:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:36:38.580570 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-bc505201-b81a-4477-8832-e3b379bf24b7 req-dc09bd82-3c10-426d-a365-42cc1c1d2e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7869e9-27fc-4ff5-98fd-b43c6d0f8039", "name": "network-vif-plugged", "status": "completed", "tag": "c84948e6-48aa-4445-a165-19b370bebd0b"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:36:38.582070 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:36:38.582070 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:36:38.589397 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-bc505201-b81a-4477-8832-e3b379bf24b7 req-dc09bd82-3c10-426d-a365-42cc1c1d2e11 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:36:38.589844 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-bc505201-b81a-4477-8832-e3b379bf24b7 req-dc09bd82-3c10-426d-a365-42cc1c1d2e11 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:36:38.601236 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-bc505201-b81a-4477-8832-e3b379bf24b7 req-dc09bd82-3c10-426d-a365-42cc1c1d2e11 service nova] Creating event network-vif-plugged:c84948e6-48aa-4445-a165-19b370bebd0b for instance dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 on hv-cinder-81803 Nov 19 03:36:38.606299 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-bc505201-b81a-4477-8832-e3b379bf24b7 req-dc09bd82-3c10-426d-a365-42cc1c1d2e11 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029563 Nov 19 03:36:38.606965 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 647/1375] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:36:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:37:20.459211 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:37:20.459740 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: Fri Nov 19 03:37:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:38:05.434810 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-e302e232-1a6b-4ac5-90a0-6e562dddebff tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:38:05.435459 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e302e232-1a6b-4ac5-90a0-6e562dddebff tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:38:05.443375 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e302e232-1a6b-4ac5-90a0-6e562dddebff tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:38:05.444410 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e302e232-1a6b-4ac5-90a0-6e562dddebff tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:38:05.445214 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e302e232-1a6b-4ac5-90a0-6e562dddebff tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:38:05.445652 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-e302e232-1a6b-4ac5-90a0-6e562dddebff tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:38:05.472813 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-e302e232-1a6b-4ac5-90a0-6e562dddebff tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Going to try to terminate instance {{(pid=116065) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 03:38:05.504423 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-0af54233-46e2-4c89-abb1-66794829ec3a req-4d7da689-fa96-4e97-8d9c-35b681f3b5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7869e9-27fc-4ff5-98fd-b43c6d0f8039", "tag": "c84948e6-48aa-4445-a165-19b370bebd0b"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:38:05.506914 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:38:05.506914 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:38:05.520118 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-0af54233-46e2-4c89-abb1-66794829ec3a req-4d7da689-fa96-4e97-8d9c-35b681f3b5d1 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:38:05.520617 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-0af54233-46e2-4c89-abb1-66794829ec3a req-4d7da689-fa96-4e97-8d9c-35b681f3b5d1 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:38:05.532993 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-0af54233-46e2-4c89-abb1-66794829ec3a req-4d7da689-fa96-4e97-8d9c-35b681f3b5d1 service nova] Creating event network-changed:c84948e6-48aa-4445-a165-19b370bebd0b for instance dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 on hv-cinder-81803 Nov 19 03:38:05.539045 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-0af54233-46e2-4c89-abb1-66794829ec3a req-4d7da689-fa96-4e97-8d9c-35b681f3b5d1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105195 Nov 19 03:38:05.540066 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 648/1376] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:38:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 03:38:05.556352 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-e302e232-1a6b-4ac5-90a0-6e562dddebff tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 204 len: 0 microversion: 2.1 time: 0.125792 Nov 19 03:38:05.556929 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 729/1377] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Nov 19 03:38:05 2021] DELETE /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 03:38:05.565799 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-a1b7b56d-03e2-4280-8058-06feae61c543 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:38:05.566673 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-a1b7b56d-03e2-4280-8058-06feae61c543 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:38:05.580654 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a1b7b56d-03e2-4280-8058-06feae61c543 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:38:05.581117 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a1b7b56d-03e2-4280-8058-06feae61c543 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:38:05.581960 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a1b7b56d-03e2-4280-8058-06feae61c543 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:38:05.582432 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-a1b7b56d-03e2-4280-8058-06feae61c543 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:38:05.798401 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.policy [None req-a1b7b56d-03e2-4280-8058-06feae61c543 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116066) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:38:05.806882 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-a1b7b56d-03e2-4280-8058-06feae61c543 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1567 microversion: 2.1 time: 0.245174 Nov 19 03:38:05.807704 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 649/1378] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:38:05 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:38:06.825353 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-abecd007-db02-4978-b73c-b8255ec3fa8c tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:38:06.826049 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-abecd007-db02-4978-b73c-b8255ec3fa8c tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:38:06.832039 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-abecd007-db02-4978-b73c-b8255ec3fa8c tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:38:06.832486 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-abecd007-db02-4978-b73c-b8255ec3fa8c tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:38:06.833264 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-abecd007-db02-4978-b73c-b8255ec3fa8c tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:38:06.833695 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-abecd007-db02-4978-b73c-b8255ec3fa8c tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:38:06.968142 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-abecd007-db02-4978-b73c-b8255ec3fa8c tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:38:06.975485 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-abecd007-db02-4978-b73c-b8255ec3fa8c tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1448 microversion: 2.1 time: 0.154100 Nov 19 03:38:06.976045 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 730/1379] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:38:06 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1448 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:38:07.865851 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [req-b5e69b55-a380-409a-98f2-a0617ff3b622 req-30877037-d031-4fb2-9134-42b3bf31a3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7869e9-27fc-4ff5-98fd-b43c6d0f8039", "name": "network-vif-deleted", "tag": "c84948e6-48aa-4445-a165-19b370bebd0b"}]} {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 03:38:07.867589 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 03:38:07.867589 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: warnings.warn(msg) Nov 19 03:38:07.876582 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-b5e69b55-a380-409a-98f2-a0617ff3b622 req-30877037-d031-4fb2-9134-42b3bf31a3b8 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:38:07.877016 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [req-b5e69b55-a380-409a-98f2-a0617ff3b622 req-30877037-d031-4fb2-9134-42b3bf31a3b8 service nova] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:38:07.888880 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.compute.server_external_events [req-b5e69b55-a380-409a-98f2-a0617ff3b622 req-30877037-d031-4fb2-9134-42b3bf31a3b8 service nova] Creating event network-vif-deleted:c84948e6-48aa-4445-a165-19b370bebd0b for instance dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 on hv-cinder-81803 Nov 19 03:38:07.894087 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [req-b5e69b55-a380-409a-98f2-a0617ff3b622 req-30877037-d031-4fb2-9134-42b3bf31a3b8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032070 Nov 19 03:38:07.894789 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 650/1380] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Nov 19 03:38:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 03:38:07.992197 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-a54acf52-b82d-4d60-9697-9e7a5ccf588b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:38:07.992807 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.compute.api [None req-a54acf52-b82d-4d60-9697-9e7a5ccf588b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116065) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:38:07.999125 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a54acf52-b82d-4d60-9697-9e7a5ccf588b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:38:07.999572 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a54acf52-b82d-4d60-9697-9e7a5ccf588b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:38:08.000344 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a54acf52-b82d-4d60-9697-9e7a5ccf588b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:38:08.000789 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG oslo_concurrency.lockutils [None req-a54acf52-b82d-4d60-9697-9e7a5ccf588b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:38:08.059971 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.policy [None req-a54acf52-b82d-4d60-9697-9e7a5ccf588b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2083348f6849b5b31fde15ae29f84a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1793e5d8d8432498e1c34ec1d15321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116065) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 03:38:08.067404 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-a54acf52-b82d-4d60-9697-9e7a5ccf588b tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 200 len: 1219 microversion: 2.1 time: 0.078848 Nov 19 03:38:08.067954 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 731/1381] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:38:07 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 03:38:09.085298 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-64b03038-4915-4f92-9d86-4ec2079ef000 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '>' {{(pid=116066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:38:09.086000 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.compute.api [None req-64b03038-4915-4f92-9d86-4ec2079ef000 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] [instance: dc7869e9-27fc-4ff5-98fd-b43c6d0f8039] Fetching instance by UUID {{(pid=116066) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 03:38:09.092618 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-64b03038-4915-4f92-9d86-4ec2079ef000 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:38:09.093056 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-64b03038-4915-4f92-9d86-4ec2079ef000 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:38:09.093824 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-64b03038-4915-4f92-9d86-4ec2079ef000 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 03:38:09.094245 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG oslo_concurrency.lockutils [None req-64b03038-4915-4f92-9d86-4ec2079ef000 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Lock "9f5aef8a-580c-45ec-80bb-74d6e2886ba8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 03:38:09.108218 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.wsgi [None req-64b03038-4915-4f92-9d86-4ec2079ef000 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] HTTP exception thrown: Instance dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 could not be found. Nov 19 03:38:09.108788 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: DEBUG nova.api.openstack.wsgi [None req-64b03038-4915-4f92-9d86-4ec2079ef000 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Returning 404 to user: Instance dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 could not be found. {{(pid=116066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 03:38:09.109588 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO nova.api.openstack.requestlog [None req-64b03038-4915-4f92-9d86-4ec2079ef000 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039" status: 404 len: 111 microversion: 2.1 time: 0.028567 Nov 19 03:38:09.110107 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: [pid: 116066|app: 0|req: 651/1382] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Nov 19 03:38:09 2021] GET /compute/v2.1/servers/dc7869e9-27fc-4ff5-98fd-b43c6d0f8039 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 03:38:09.266719 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: DEBUG nova.api.openstack.wsgi [None req-8184b87b-3082-4319-b1e6-30d0e25c8d39 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] Calling method '.version_select at 0x7f8459f71310>' {{(pid=116065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 03:38:09.292288 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO nova.api.openstack.requestlog [None req-8184b87b-3082-4319-b1e6-30d0e25c8d39 tempest-TestShelveInstance-678443608 tempest-TestShelveInstance-678443608-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1388976346" status: 202 len: 0 microversion: 2.1 time: 0.029182 Nov 19 03:38:09.293540 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: [pid: 116065|app: 0|req: 732/1383] 10.222.0.47 () {58 vars in 1253 bytes} [Fri Nov 19 03:38:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1388976346 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 03:39:58.316961 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:39:58.317628 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: Fri Nov 19 03:39:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:40:06.018285 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:40:06.018890 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: Fri Nov 19 03:40:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:40:18.990182 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:40:18.990775 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: Fri Nov 19 03:40:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:40:21.172990 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:40:21.173527 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: Fri Nov 19 03:40:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:40:40.478321 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:40:40.478912 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: Fri Nov 19 03:40:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:41:37.262207 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:41:37.262730 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: Fri Nov 19 03:41:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:43:18.333954 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:43:18.334435 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: Fri Nov 19 03:43:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:43:26.035893 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:43:26.036659 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: Fri Nov 19 03:43:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:43:39.007835 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:43:39.008407 dv-cinder-818037-4-iscsi devstack@n-api.service[116065]: Fri Nov 19 03:43:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 03:43:41.190954 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 03:43:41.191523 dv-cinder-818037-4-iscsi devstack@n-api.service[116066]: Fri Nov 19 03:43:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!